I am a by ual man that wears panties?

its not ual perverted thing its comfort thing I just think boy shorts and hipsters are very comfortable but why when I buy some at the store did the cashier call me a cross dressing fag. I know I'm not its just a preference thing i need some insight my ex girlfriend thought I looked good in her boy shorts hell she wore my boxers all the time i see no problem