You have found the problem, and is that you are scared of your feelings. Most of the time when someone is scared of their feelings is because when you confess your feelings, you feel vulnerable, and easily damaged. Other thing might be that you are scared to compromise yourself, because you are scared to settle down. Both situations lead to a selfdestructing thinnking and doing, boycotting your relationships. More than a psychologist you need a counselor. My opinion of what you could do is:
1)relax yourself and dont think about it too much, it could confuse you even more.
2)try to do fun activities with him, you know, whe you are doing something that requires your attention, you forget those kind of things. Besides, it makes you more open to him, and by having great time with him, you might have a greater image of him.
3)to have a deep bond with someone takes time, before that, you have to slap yourself, and even if it hurts, open yourself to him, I know this is cheezy, but its true. you need patience, and for that patience, you must keep seeing them, love is a constant fight, dont be scared if your feelings are true, when things are said truthfully, they are easily said and makes you feel free. You have to believe in what you say and in what he says. and yeah, Im cheezy, but its true...