This sounds like you’re having problems with your own network. The 9999 ping happens only when the server wasn’t removed from the server list – either it didn’t shut down gracefully or it’s still up but unresponsive – but that never happens for a whole bunch of servers at the same time.
When you’re playing on the server, do you have the debug HUD active? If so, what ping does it normally report?