In order for you to kick them out, you need some kind of majority, I think its around 75-80% of the players must also vote them out.
not sure though.
also if youre the admin, you can also kick them out.
edit: thanks for editing your post illkid, now i look like an idiot

imhotepMP