I think I know what you mean.
I used to be, on my side at least, seemingly close, as a friend to somebody I no longer really talk to anymore.
After a short but intense and fun start to the friendship, I started to feel the same way as you do, that he was in fact, IMO, using me but I couldn't put my finger on concrete examples to begin with. It was a strong gut feeling.
The more distance in time I had away from him, the clearer it became to me. Although for the very predominant part, at first at least, I had a lot of fun hanging out/talking to him, and cared about him etc, and it seemed mutual in that regard. Eventually though, it felt like he was being manipulative, although in a very subtle way, that my other so-called friends in our group didn't even seem to realise. A lot of the negative things were only witnessed by me, and they were so fleeting and subtle that even I hardly cerebrally recognised them for what they were for a while, but, I certainly 'felt' it.
I felt like he wanted to use a friendship with me to meet more people (my friends, university parties/girls, and or to go out bar crawling/clubs for him to meet girls and or simply to get out of the house), I suspected he didn't really respect me (although he kept it quite hidden for the most part), and made it clear to me on occasion, and in private, that he'd like to hook up with me on the DL, despite claiming to be 100% straight and taking jabs at 'fags' in front of others.
I started to distance myself from him somewhat, but not cut him off completely, and the subsequent reaction was very childish on his part. Ranging from manipulating our mutual friends to invite me out with the group (after months and months of neither of us communicating), instead of doing it himself in case of loosing face, telling me online that he wasn't really my friend anyway and was simply 'using you for my pleasure', then ignoring this comment and pretending all is cool a few weeks later, or ignoring me, declining an open ended invitation to meet up as 'pay back' it felt, to acting super hurt but quiet about it when I did meet up with our then group of friends, playing the victim to them no doubt, about how I have now become cold and iced him out, making them feel sorry for him and resenting me for distancing myself from him (even to the point of doing the same to myself- none of them ever really had a one on one conversation with me as to why I had distanced myself, but just jumped to their own, incorrect, conclusions).
After a while, I simply stopped talking to him altogether, and left the group of friends more or less, but still occasionally keeping in contact with those I thought were more mature, respectful and genuine friends (one in particular who I was friends with for much longer than the rest). Too much mind games, drama and childishness for me. It was starting to effect my general mood, distract me from the things I needed to focus on in life and depress me.
A few years later, I made the decision to try and see if a friendship between this guy and I could actually be salvaged after perhaps bringing up and discussing some of these issues with him and coming to a resolution and moving forward in a mature, adult way. He really didn't want to discuss the issues. Too deep I suspect. Brush it under the carpet and act like nothing happened between us and as if we were as close as we were 3 years earlier was more the vibe I was getting from him. I couldn't really do that. It would take some more time to build a friendship up again for me, but I was certainly open to trying. Then, old patterns seemed to re-emerge. Mind games, childish antics of 'get one up'-ship, then no doubt playing the victim to our other 'mutual' friends etc.
I was now officially done. No ill feelings any more. Just, done. Wish him the best (I might always care for him/his better qualities, to a degree, but...). Closure.
A lot of times out gut instincts in our relationships with others can be very powerful and useful.