I went through this before, and lost quite a bit of old e-mails, but I think I finally have it down. Do a search for "outlook.pst" which is where all your e-mails are stored. If you use outlook quite a bit, it should be a sizeable file. Mine's around 50 MBytes. It saves your Contact Information and the like, I'm not quite sure about Calendar, Notes, and Tasks.
If you have Rules, you need to export from Rules Wizard, because Outlook doesn't save that information in outlook.pst for some reason.
Good luck!