When the time is right, it will feel right. You shouldn't be afraid or worried or anything about having sex. If that means waiting until you're married to you then you should wait. If he loves you he'll be able to respect that. And besides, think about how much you'll be giving him when you are ready and it can really be special. I think that's worth it.
It sounds like he is respecting your feelings so you shouldn't feel like you need to sleep with him. Relax. It'll be okay.
And no matter what my heart [</3] says
I have to let you walk away
maybe someday
I can't fight for you anymore
But it's too hard to watch you fall.
I can't fight for you anymore
But watching you go breaks my heart
I can't fight for you anymore
But I want to.