Hah, with my luck, it probably is gremlins.
Thanks for the input, I'll try to track down the service manual and board diagram.
As an update, the cable was going in and out while plugged in (e.g., signal going black or to static), so I tried plugging my Playstation into port 1. TV didn't...