Wow, I'm kinda surprised when I hear about things like this since my Lan and sound are on the mobo. That leaves my video card for the AGP slot and thats it, my 6 or 7 PCI slots are all empty.
Two things to note with that many cards, when the system boots (I'm not sure on this, don't quote me on it) it may load the drivers for each USB card seperately. That would significantly increase the time it takes to boot up. I relized this when I remove a USB card which I don't use any more and an ATI TV Wonder card since soon I plan to upgrade to a 9700 Pro AIW with a tv tuner in it. Now, even on my P4 1.7ghz, 578 mb ram, I turn my computer on, and then once I turn my monitor on (takes only a few seconds to show whats happening) the loading of user files is almost done. I'm using Windows XP Pro and the only other two things that startup is a firewall and antivirus.
Have you tried testing the cpu load when using a USB hub? I use one hub even though I have 3 of the 4 usb slots empty because it brings the cable closer to me. All I have is a keyboard, mouse, and a smaller mouse by fellows which fits into my finger, (best thing ever!).