Are you talking about the "feature" that XP added that stacks multiple windows of the same application in one taskbar button instead of a seperate taskbar button for each open window? This is not specific to IE - it's an XP feature. I agree- it's annoying as hell.
Right click the taskbar -> Properties -> Taskbar tab -> uncheck "Group similar similar taskbar buttons"
Hope this helps...