Bipolar disorder is one of the mental health conditions that requires long-term medication. Sometimes it takes a while to find the right combination that works for you, and it can be difficult to tolerate uncomfortable side-effects. As your body adjusts to the medication the side effects should reduce. Your psychiatrist should closely monitor your reactions to the meds, and adjust them accordingly. Try to be patient during this time, and try to accept the fact that medication is a must for treating bipolar disorder.
In addition to psychiatric treatment you should consider Cognitive Behavior Therapy, which is a form of talk therapy which will help you develop better coping tools for the strong angry and sad emotions that you are experiencing. A CBT therapist will help you understand the link between thoughts, emotions and actions, and will help you develop adaptive thoughts that wont result in these mood swings. Other simple activities that help with mood regulation are exercise, deep breathing and meditation.