Keep in mind that a low population is when you check it. If you are looking at an Asian server when it is 3am there, that may explain it.
Look for servers during your main playing times, that will give you an indication of expected load when you are on.