this is not from actually measuring or anything, but i think its really negligable, like 1ms.
unless you were talking line speed (10Mb on a 10Mb card) then you would start to suffer. but since your home connection wont even come close i really don't think you'll notice (provided you use good nics, not 10 yr old ISA 10Mb cards)