Well thanks everyone for the ideas. I tried the various blades and techniques with the jig saw and the thing I believe is just a PoS. It still wanted to cut to the left away from the guard I had setup.
So in the end I used a 1" flush router bit and it cut the hole without issue. I did end up with a mountain of saw dust though