If one man is not enough to satisfy you then you may need to try two or even three at a time. Trust me, I've seen it on the internet and it will be just fine...
But seriously, maybe he's not the one. Try a few more guys and see if one really does it for you. There is chemistry, physics, emotions, and lots of other things involved, not to mention his skills. You cannot will yourself to get off on one particular person.