You can challenge someone to a duel, one on one only. There are a couple of arenas where groups can get involved, but I (and I think most players) don't usually bother with any PvP. I always select the option to auto-decline duel invitations.
Try rolling a toon on both types of servers and see which you prefer. You are not just limited to one server, only by the number of character slots on your account.