Yes, no problem in doing that. The only situation where you'd have to be careful is when you keep changing legacy, non-plug-and-play printers on the same physical port.
With PnP-enabled printers and particularly USB printers (which are PnP inherently), you can't do wrong.
All you need to do is pick an actually connected printer when printing something.