Often mac applications leave a file in the preferences folder (less often in the system folder itself). However, these files are typically very small, and if you aren't paranoid about getting rid of interenet cookies, you might not even want to bother removing it.
I always thought one of the best things about the Mac platform was how easy it is to install/uninstall/move programs around.