There's an underpayment penalty that can apply if you don't have enough tax withheld.
Take an extreme example: claim so many exemptions that zero tax is withheld, and then pay your entire federal tax bill on April 15. You can't do that because the IRS expects to see money from you throughout the year.
I don't know the exact rules off the top of my head but you can find it in IRS Publication 505.