Well Kuno, I can't say whether you've got Asperger's or not, because I'm no therapist, but my guess is, you don't, and I arrive at this conclusion based on the fact that I've had to walk a VERY similar path in life, and because of it, I'm pretty detached/impersonal when I deal with people too. I guess that just happens as a result of growing up with people you don't develop a true intellectual/psychological 'connection' with. I got detached partly because I knew that most people wouldn't be able to really 'metabolize' my whole personality, and that's got NOTHING to do with grandiosity; I realized that people for the most part are simple, so they didn't always have the abilty to see the whole personality I had, so I just asked myself 'what's the point? The point is, you've gotta look for people who are more YOUR speed intellectually.
I'm betting since you were very intelligent coming up through high school and university, but because you didn't really learn the softer art of socializing, it gradually became like a muscle you had to work on more consciously. Alot of intellectuals don't do well socializing because if you take an intellectual, and place them in a room full of class clowns, jocks, cheerleaders, and all the other social archetypes that the majority of society places so much emphasis/importance in/on, then the intellectual in spite of being incredibly intelligent/bright, won't naturally shine in this type of situation because his merits will seem reminiscent to the 'teacher/parental/authority' type of archetype that teens/young adults feel are oppressive...but being an intellectual you hold the advantage because you can use that knowledge to your advantage; I started to do just that, and my social life improved! I got confidence in just talking to people, but I'm STILL an introverted/intellectual, and I would rather be that way.
If you don't come off as intellectual/preachy and can just loosen up, (assuming you don't have any history of trauma/abuse/ in your past) socializing for you should be a breeze! People who party love videogames, alcohol, partying, dancing, etc. when I'm with people who are more party, alcohol types, I can turn on the confidence more because I know (even if this seems a little TOO BRUTAL) I'm more intelligent than most of them, so what do I care if they like me, or not?! I suggest the same approach for you. There's confidence, arrogance, grandiosity, and then there's quiet confidence...use it to your advantage by knowing who you are, and what you've got to bring to the social table man!
I can only engage in this stuff every ONCE in a while with people en mass, but having a get together with a few people I trust/know/like well, is better. JMO.