Well, don't feel ashamed to be attracted towards men AND women

If I remember correctly, it's fairly common for HPD sufferer to be bisex...it can be related to the disorder, or not. Anyway, this does not represent a problem, since sexual tastes are perfectly fine as long as you don't hurt anyone.
The important thing is to tackle effectively the disorder, i.e., go to a therapist.