It really depends on the people surrounding you. Some office environments can be pure hell, but the same can be said about almost any work environment. It can be good or bad. I've worked in some call centers that were very annoying, but it was also partly because of the nature of the business and the business being sketchy as well. Now I work for IBM and the work environment is 10x better than my previous office jobs. I honestly can't complain, pays more, the people seem to be cool and they don't seem all stressed out. The stereotypical hell-hole office environment is hell, but they really aren't all like that. Honestly, I probably wouldn't believe me if I hadn't seen my current job for myself.
I've worked various types of jobs, outside as well... and it's not necessarily better just cause it's outside! There can be just as much drama, and you're subject to the weather.