Yup...you have FDISK it in DOS.  Shutdown to MS-DOS mode, or boot up with safe mode command prompt.
It can't be done from the control panel.
If you have Win95B or above, when you start FDISK, it will give you the option to enable large hard disk support.  Hit Y to use FAT32, hit N to use FAT16.