do I really need to treat partial complex?

Hi, I am looking for some opinions as my neuro evaded this question. I was diagnosed with partial complex seizures, fronto-temporal lobe epilepsy. I have only had 2 seizures during the daytime in the last year. I may have had a few at night because I woke up biting my tongue. My neuro says I may not know when I am having a seizure. Is that right? Do I need to treat it if it doesn't bother me? I miss driving but it's not a huge factor. I have tried 2 meds and been allergic. I am honestly afraid to try more as they affected my breathing. I also have memory problems. Forgetting words, call my kids the wrong names, even forget I am cooking lately. Will this get better with meds? Can it get worse if I don't use meds? Does anyone know if having epilepsy is common? I am wondering how much experience my neuro has with this as he never answers a single question. I am wondering if maybe he may not have many patients with it, although from what I read, epilepsy is not that uncommon. Any answers would be great. Plus, if I take the meds, how do they know when you can drive safely again? Thanks a lot for your help! Wendy