One thing I really want to look into at some point when I know more about component level electronics is to design a KVM, and also a hardware version of Synergy, it could probably just be the same product. Would be modular so you can just hook up more together for more ports. The way I would make it work is that all the computers plugged into it see a mouse, keyboard, and monitor, at all times. When you switch to a machine, all it would simply do is translate the signal from each device and then send it to the appropriate computer, vise versa for the monitor. This would make it more reliable and also make it switch instantly. Essentially, the KVM is always controlling the computers and you are controlling the KVM, the KVM just relays the signal to the one computer that is selected, and only reads data from the monitor port of the computer that is selected. I'm really not sure why this is not already how it's done. It would make them really reliable as switching between machines would no longer be equivalent to unplugging/plugging the peripherals.
I'm thinking using some kind of HID chip implimentation and DP or HDMI driver chip this could probably be done. Then a microcontroller to simply tie them together.