No need to try and delete. Just fix the files, easily. Have your XP CD ready, and in the drawer (cancel out of the graphic that comes up when you insert the XP CD).
Now, once you have the XP CD in your CD Drive, click the Start Button. Click Run. Type in (without the quotes):
"sfc /scannow"
Note that there's a space between "sfc" and "/scannow".
Click OK after typing sfc /scannow in the run box. A small rectangular box will come up on the screen, telling you it's checking the XP system files. It will repair any that have been corrupted or modified. And don't worry, it will automatically take into account any updates, like hotfixes and service packs.
Try it. It will fix IE in XP.
Note: The System File Checker (SFC) will not tell you exactly what it's fixing. And it won't do anything after it's finished but disappear from your screen. When it's finished, reboot the pc and see if IE is OK.