I'm usually not an alcohol snob, but...
If you're tempted to mix the spirits you're drinking with something else, then you should try getting something a bit better or different. Occasionally I enjoy mixing whiskey, Scotch, bourbon, etc. with a bit of ginger ale (blasphemy, I know), but it's usually something that isn't very good on it's own (Johnnie Walker Red Label, I'm looking at you).
Most (not all) of the higher end whiskeys are perfectly drinkable on their own, and far more enjoyable to sip straight up or on the rocks. They're not the type of thing you'll want to guzzle down just to get smashed - the key here is sipping. When I tried Scotch for the first time, I bought a bottle of Glenlivet 12yr just to see what all the fuss was about. I poured myself a glass, took a gulp, and sat there puzzled how anyone could be so obsessed with the stuff. It was alright, but it didn't seem worthy of the higher price tag compared to much cheaper spirits, even rum. Toward the end of the glass, I was sipping it slowly "just to get rid of it," and suddenly noticed the complex aftertaste. THAT's what the fuss is all about. It was a night and day difference.
You don't have to go all out and spend hundreds of dollars to get something good, and there are even rare gems mixed in with the bottom or mid-shelf stuff. Try different things, figure out what you like, and enjoy - but don't drink it just because you feel like you should.