1. Export your favorites to a file using File->Import and Export...
2. Delete all your favorites from IE and clear the Temporary Internet Cache
3. Import the favorites using File->Import and Export... and use the file created in (1). Any personalized icons should be gone.
If you just have one or two customized icons, you could just right-click the favorite and change the icon to the default IE icon manually.