Maybe I missed it, but OP, have you been working at the same place since you graduated? If so, that's 99% of the problem. Different companies have different working schedules - at one company you put in your 40 hours and you're done, at others you put in 50 hours and management sees that as just doing the minimum. I know some ex co-workers at large government contractors (i.e. Raytheon) who get paid very well and are on a 4/10 schedule, and one of them was never the brightest tool in the shed...
He job-hopped after this place for a few years.
As an EE, there are only a few ways you are going to be satisfied in regards to workload and pay:
-Be an absolute rockstar and become one of the top-level guys - this requires passion for the work and of course the smarts
-Go the management/business route, but this comes with its own amount of stress so you're gonna have to be good at dealing with idiots
-Job-hop until you find a company with good pay, benefits, and work-life balance
BTW, ~$200k between just you and your wife is excellent and nothing to sniff at at all, especially if you're talking about buying a $500k house. You could think of it as both of you are each making $100k, if that makes you feel any better.
As an anecdote, I've worked at my current job for ten years. It was my first job out of college and I also had a co-op with them while in school. I'm not passionate about the work or my career, but I tend to enjoy it far more often than not, and I work with some absolutely brilliant engineers, and I like the vast majority of my co-workers. I've found my "niche" here and I'm paid well; I could be making quite a bit more if I switched jobs, but I'm comfortable where I am. I also have a four monitor setup (counting my laptop screen), and there's no way I'd get that at a new job. I worked hard for it! At this point, I want time more than a pay raise.
Sounds to me like it's way past time for you to jump ship, but I suggest sticking with EE at least for now. A new company in a separate area of EE may spark something inside you.