Abnormal EEG, no seizures. Worried.

I am a 22 year old female, about 5 years ago I was admitted to a psychiatric clinic due to problems I faced at home with family. Psychiatrist so there performed many tests on me including MRI and EEG. What came to my attention was my eeg result so were abnormal, my psychiatrist look confused explaining that it showed seizure activity in my sleep. She asked me if I ever experienced seizures in my life and I seriously haven't not even blackouts or absence that me or anyone close to me has ever seen. She put me on anti epileptic medication that I refused to take, why diagnose me with epilepsy from an abnormal eeg yet i have never ever experienced a seizure/seizure activity before? My mother says I've never had one even as an infant. 5 years later and this still lurks in my head making me think that an abnormal eeg may have an effect on me later? Does it mean that I have epilepsy/seizures that may manifest later on? I'm really anxious about this and need to know. I've asked a number of websites but no answer, hopefully I'll get one on here. 5 years later, 6 year in fact, and still nothing has happened, just still wondering. I did some research and found that abnormal eeg doesn't diagnose epilepsy. I did have plenty of caffeine the day of the eeg and wasn't warned not to. Can that me the cause? I just need this justified as I'm really worried. Any help? Thanks