It's an old expression from medieval Ireland or England, IIRC.
In the old days, they used to have a palisade or wall called "the pale" that surrounded a town, to keep the outlaws and other undesirables out. They used to refer to those people as being "beyond the pale".
Edit: The Urban Dictionary entry is pretty spot-on too. :thumbsup: