Not entirely. When you're driving, other people are on the road too, so an accident is not within your control. When you're eating, what you put in your body is entirely on you. As long as you exercise some basic common sense, you'll generally be fine. I wouldn't eat sushi that's been left out all night, but I will eat pizza. It's almost always better to put food in the fridge, but if something spends a few hours out of the fridge, that doesn't automatically make it bad. If it smells or looks funny, don't eat it. It's fairly straightforward.
Incidentally, the only times I've gotten food poisoning has been from freshly prepared food in a restaurant. Obviously they're following the requirements for "safe food," but those guidelines won't prevent 100% of food poisoning cases. So I figure, hey, safety is all well and good, but I'm not going to do it to some insane degree.