Monthly Seizures

I have what I think is focal seizures (I just stare or space out) on a monthly basis. I started having them when I was 17. I went to the doctor then and was told I was having panic attacks. I took that diagnosis for 17 years until I heard someone give a presentation on epilepsy. As I sat there and listened I was in shock. As she described the different types of seizures I realized that was what was wrong with me. I have my seizures for about 4-5 days a month. The last about a minute or two and I am very tired afterwards. The first day I have about 10, starting as soon as I get up at 5. By noon I have usually had about 5-6, then they taper off to every few hours. The next few days I have then randomly throughout the day becoming fewer and fewer as the days go on. By day 4 or 5 I probably have 1 or 2. I do have them when I am asleep but I am not sure how often. I am a very light sleeper and sometimes I can't tell what woke me up. They are getting worse and my memory is going. I had one while having a conversation with my boss and she told me that I started talking about something that made no sense. I have had an MRI, sleep deprived EEG, gone to the hospital and had and EEG on the first day of my seizures where I thought they caught one, and had a two day mobile EEG. All showed nothing. I have been on several different meds and the only thing that seems to work is Topomax but only for a few months then back to full seizures. I tried keeping a calendar to see if it was related to my period but some months I have them with my period and other months I have them between my periods. I have tried birth control for the hormones to see if that helped, nothing. I am now 37, been having these for 20 years and losing my memory very badly. My Family and friends can tell when I am having them but most people can't. The doctor thinks I am crazy. Someone please tell me I am not the only one with this problem.