Open steam, go to “Visualization”, from there fo to “Servers”, go either to history or favourite, click your favourite server and click “View information”, in the low left corner it’s going to be a button “join”, when you press it if it’s full it’s going to give you an option “Join the server as soon as a slot is free”.
Something along those lines.