I am in the same boat. For me it is not isolated to just other men, but men are easier to find, and it was easier for me to define it as a form of extended masturbation if it was not a woman. All self lies I continue to tell. I would be with a guy and would do anything, and once I came, I was as straight as an arrow wondering how the hell to get out of there, and ashamed.
If you are driven to do this and you feel it takes you away from the things you care about, you should not let yourself feel ashamed; admit it, step up and start defining what is important, and what it takes to know thyself and define your path to get where you really want to be. This was a great step on that path, congratulations, and keep going.