HDMI switch issue

SAWYER

Lifer
Apr 27, 2000
16,742
42
91
Setup
Chromecast and a jailbroke Apple TV 2 into this switch
http://www.amazon.com/gp/product/B00...?ie=UTF8&psc=1

then the output of the switch goes into the hdmi input on my Xbox One. As it is hooked up it works fine but I have to use the remote that came with the switch between the two. I also have a Harmony remote but I still dont want to change inputs, the switch said it was auto switch but I dont know how, what should I do?