No, not really. The only people it would be chaos for is those who are not self-sufficient and for those who monopolize, cheat, aggress against other people, and steal. The banksters would hate it because the supply of credit would be so tight that no sensible person would borrow anything, which would mean very little money for lenders. Who made the Rothschilds? The British tax-payer. They could not have made so much money if it weren't for governments. Or at least they couldn't have made it quite as easily and it would've had to have been through a voluntary contract. Halliburton would hate having limited or no government, because then they'd be out of an involuntary contract. Dick Cheney is not a self-made man. The tax-payer made him, and the tax-payer should break his sorry dependent ass.
Most of the people on Wall Street are not self-sufficient. They rely on uniform legal tender to get rich.
Just as my dad (who actually provides a service that would be needed in a truly free market and pays more as a percentage of his income in taxes than they do) has helped make their dependent asses, he could help break their asses. Unfortunately, he's too much of a pussy to do so. However, I'll make sure that my generation and I break their asses and purge them into a stateless society which will be chaos for dependents like them, but utopia for people like me.
Y'know those drug cartels? Antifederalists would put their sorry asses out of business.
Y'know those "welfare queens"? They too would be forced to work and they could no longer live off the tax-payer in an Antifederalist society. People could do whatever they wanted with their labor and the fruits of it. There would no longer be a monopoly on force, justice, or anything else. the cops, the military, and the courts have screwed up so much because they can't go out of business.