If you shut it off from Control Panel, it will stay off forever.
I'm on Vista, but there is an icon for Regional and Language settings in Control Panel. You have to dig in about two or three layers deep and uncheck a box and it's gone after that.
I'm sorry about the vagueness, but it's a little different in Vista and I can't remember exactly what to click on.
Edit: The thread appears to be dead, but for those that need it, I'm on an XP machine now.
In CP;
Regional and Language Options
Languages Tab
Details Button
Language Bar Button
Uncheck everything there
Back out and Apply when possible.