Advice for dating someone with epilepsy

Hello, I came onto this site to see if anyone else that has had a relationship with someone that has epilepsy could help me out with some advice. I have a boyfriend who has epilepsy and has many type of seizures. I went into this relationship not knowing much about epilepsy. This is where the advice comes in. He has had a terrible past and developed many psychological problems such as bipolar disorder, PTSD, ADHD, antisocial disorder, as well as anger management issues. He also has some brain damage. He currently takes medication for his seizures on a daily basis. The problem is his emotions are so out of control that anytime we have an argument or I say something he doesn't like, it will trigger him into having a seizure of some sort. Luckily, it has not been a grand mal but I do not want it to get to that point. I don't know what to do anymore, I am thinking of breaking up with him because I don't want him to get to a grand mal. It is so hard to keep a healthy relationship with someone who gets explosive at little things that bothers them, then leads them to a seizure because of that. What should I do? I have tried talking to him without myself being angry but he still gets extremely angry or extremely stressed which then causes a seizure. He does not want to break up with me.