I have wondered about this for a long time. In my lifetime, I've met few people who I really "connected" to on a deep level. I have few but very loyal and close friends who understand my weirdness. They enjoy it, in fact, because they know I'm naturally quirky and can only be myself when I'm not "faking" it for others.
I have yet to meet someone who I have romantic interest in who understands ...