I think this game attracted a niche community to begin with, so most players are seasoned fighters. I am seeing a much higher skill level on PSN than for something like SSFIV where 90% of the people do random ultras and couldn't play footsies to save their life.
The only thing I dislike is that when I usually get into playing (weekends really late night / early morning) the majority of players are Japanese and dislike playing Americans for some reason.
I've only ever played ranked matches so I haven't had that problem yet.