TIM-clean cleaning solution and a foam swab of some sort.
You can also use alcohol or degreaser in place of TIM-clean cleaning solution. IMHO it's best to get your cpu up to full load and run it for a while ( 5 minutes at full load or more ) to get the cpu and thermal paste hot. This makes it easier to clean the gunk off.