To your last point, most women don't want men in their sports, but have been pressured to go along with it.

It is okay to exclude men from women's sports because women have the right to sex-specific spaces.