chillie,
wherever you have the shortcut to Windows Explorer, right-click on it and pick properties.
A box should pop up titled Windows Explorer Properties
There are two Tabs at the top, General and Shortcut, it should open on shortcut.
What you want to do is modify the target line with the above options.