Use a lint-free cloth to clear away any goop (lint may otherwise get in the microscopic imperfections, hindering heat transfer - not much, but why let any get there?), and put some alcohol on the cloth, then wipe away on the top of the CPU.
This is what I did at least.
As for "drying", the alcohol will probably evaporate pretty quickly, so it shouldn't be too much of an issue.