PLEASE HELP. NO ONE HAS ANSWERED...?

I've been single for 25 years and I finally met someone I REALLY liked. For the first time in my life I went on a first date and thought "It's him." At first we were taking it slow because it takes me a while to open up (as I told him) and I was even a little embarrassed that I'm shy at my age but he made me feel OK about it and was the one who did all the talking, called me, texted me, made me laugh, etc. Then I became more comfortable with him and started to trust him and that's when things went bad. We were at a place where I assumed that the weekends were dedicated to one another (because all others had been) and so when a weekend came I didn't call him expecting to hear from him at some point about making plans and I didn't hear from him. On Friday I was a little shocked so I texted him later in the day and asked what he was doing and he said (in a friendly way) that he was with his friends. Then Saturday came, I assumed THEN he would call/text and again, he didn't. Later that night I did the same and asked about his day. We had a text conversation but it was very short. Then Sunday came. I knew when he was done with work and he normally texts/calls right away but this time he didn't. Later that night I sent him a massive text saying I felt weird about things, his distance in my mind that translates things are over and that if he wanted to keep things alive we needed to talk about the future of this relationship. He called right away and acted bewildered..What? Sorry you feel that way. I didn't mean to do that. The next few days he was very attentive but then all of a sudden when I asked him to go to a wedding he made an excuse (he couldn't take vacation days bc he has to visit his family this month) and then all of a sudden this day he's distant again. What should I think about this? I feel really involved with him and want to make it work but does this mean game over?