Ok, let me take a crack at this...
There are a few types of switches, let's cover "store and forward" what this means is the switch can listen on all ports at the same time, and send on all ports at the same time. Ok, here is the catch, in order to go from listening to sending the switch has to receive the "packet" process the "packet" find the correct port, then transmit the packet. The processing is the "storing" of "store and forward".
So basically it does have to take turns on each port, but given that(i'll use a netgear switch for this example) a netgear switch can:
Forward rate (10 Mbps port) 14,800 packet per sec
Forward rate (100 Mbps port) 148,000 packet per sec
Latency (10 to 100 Mbps) 80 usec max
All this happens so fast it will seem like it all occurs at the same exact time. Along with the ability to handle full-duplex operation.
Your real question makes me wonder do you know the difference between a switch and a hub?
To put it simple a hub can only handle, half-duplex and it will echo all errors to all clients where a switch would filter these errors. These errors being echoed is what really kills a network. More clients = more errors, it happens. These errors can be anything from collisions to broadcast storms.
Hope this helps...