Tires have a finite amount of grip, that grip can either be used laterally (to steer a car) or longitudinally (to propell a car), or in a combination of both. However, since there is only a finite amount, if a tire is used both laterally and longitudinally (ie. driving a car and steering as in a front drive car) then there is less grip available for each direction. In a rear drive configuration, the front tires are devoted to lateral forces while the rear are devoted (for the most part) to longitudinal forces, this allows the grip of all four tires to be used most efficiently. Also, a car handles best when it has a 50% front / 50% rear weight distribution, front wheel drive cars almost never achieve this because the vast majority of essential mechanicals are packed up front and not spread throughout the car, so a front driver has poor weight distribution. Also, in acceleration a car's weight shifts backwards, increasing grip for the rear wheels and lessening the grip of the front wheels, which gives an advantage to rear drive cars in acceleration as they are able to put more power down to the road. However, in inclement weather, you want all the weight possible to be on the drive wheels to give them better traction, which is where front drive's main advantage is. Front drive also gives you the advantage in inclement weather of providing thrust in the desired direction of travel, but that is not as important as the weight over the drive wheels. Front wheel drive is also safer for an inexperienced driver because there is less possibility of oversteer, which is when the rear end of a car "breaks loose" and the car spins. Because of the lessened latera grip of the front tires caused by grip being used for propulsion as well, a front wheel drive car tends to "plow" towards the outside of a curve when it's handling limit is exceeded. A rear drive car, on the other hand is more apt to spin in that situation. This is an oversimplification, but it takes care of most of the main points.
Zenmervolt
EDIT: Dang it, I took too long typing this out, started after Maximus' 2nd post.