If you add a few filter commands like, not full - ping under 175 - deicated - anti cheat software - and myabe couple others this should help. I return about 5k servers with these settings.
After the first time, yes this will work. But the first time it has to try pinging ALL of them to even find out who's under 175, playing game X, etc.
I suspect the problem is the number of half-open TCP connections waiting for servers that aren't around or are taking to long to reply. Almost like a SYN flood, but in reverse. Keep in mind a NATing router has to keep track of a lot of state for each connection when doing 1-to-N.
You either need a different server-browser, that can intelligently try blocks of servers at a time, or to lower your TCP timeout on the router (which I'm not even sure if it can be done, and could definatly have affects on other things).
bart