Had a chance to see my ex & I blew it...?

I am still deeply in love with him & I know for a fact that he still has feeling for me, we're both each others first loves. Since we broke up, whenever we see each other, its as if we never broke up, not just . So we've been emailing for the past month & a half because he doesn't have a phone, & a couple days ago he started getting mad at me bringing up sh*t from our relationship in the past. Last night he was going on and on in an email just being unintentionally mean with what he said so I didn't respond, and I usually do as soon as I read them, but I just figured I would respond the next day (today). Early this morning, I got another email from him telling me that he was in the town right next to where I live last night & that he was waiting for me to respond to that mean email & then he would've told me that he was there in response. He also said that it was his last email & that my love for him is fake, he was obviously upset that I didn't respond to him. I emailed him back telling him MAINLY that he should have called me. Plus to add insult to injury, I got 4 missed restricted calls this morning before I woke up about 2-3 hours after I received them, and I KNOW it was him, nothing else would add up. He was calling from somebody else's number....I feel miserable i'm really, really upset I feel that this is my fault and I should have written him back last night. This sucks because out of all the times we emailed, the first and only time I don't automatically respond, I miss out on something that i've been wanting more than anything. I'd take any chance I can to see him or hang out with him since I barely see him, he lives really far away from me. But I had no I dea that he was waiting for me to respond or that he was right next to me. I mean I literally feel sick to my stomach that this happened Am I in the wrong?