Router/Switch network setup question

[whitelight]

Currently, I have:

Internet -> Modem/Router:
-> Downstairs computer
-> Upstairs computer

I would like to connect a few more computers on the 2nd floor to the internet. I have a spare router lying around. Would two routers cause a problem?

Internet -> Modem/Router:
-> Downstairs computer
-> Router -> Upstairs computer -> Upstairs computer 2

Or should I get a switch?

 

[jlazzaro]

http://www.ezlan.net/router_AP.html minus the wireless stuff

look ma, i pulled a Jack~!