As long as it doesnt seem to be effecting other areas of your life, I dont see why it should be a problem.
Screw up his view of masculinity? Well...to be blunt, if he's interested in crossdressing, then its probably already a little skewed but like I said, if nothing else in your or his life seems to be effected by it, then I wouldnt worry.
As a side note, I would DEFINATELY keep your hobby under wraps, as Im sure your husband knows, people can be extremely unforgiving in the corporate world if they find out something like that.
They can't touch me while I'm alive, and after I'm dead, who cares?
-John F. Kennedy