There's a difference between right and 'right'. A gym could say women only and I wouldn't have a problem with that. If they said white women only I'm going to be pissed.
Edit for clarification: Not just white - substitute color or religion or political affiliation or marital status, etc.
Why is there a difference? By your definition, it's still discrimination. Why make an exception for one group and not another?
