Nevermind, I figured it out. Here's how if anybody wants to know:
Double click My Computer. From the View menu, select options and the File Types tab. Scroll the list of "Registered file types" and select "Folder". Depress the Edit button, and select Explore. Press Set Default and press Close and press Close.
tralala