I'm not sure the audio is an issue. It's probably fine for most. I noticed it almost immediately as I used my device at work and at home often with headphones.
I'm a cell junkie.
I got an Xperia T 2 days ago and flipped it already. Actually made a decent amount off it, but I won't get into details on that. It was a lucky deal I got it from a relative.
I loved the phone overall, except It has no development community or else I'd kept it. Timescape on it has a lot of cool features. I love being able to flash roms and customize my phones. I flip phones quite often. This is the 2nd Nexus 4 I've bought. (I flipped the first one to make some $$, yeah I'm one of those guys)
I've owned pretty much every major Android phone out over the last couple years. It's a hobby to play with hardware.
My point now - I've always been open to giving the Nexus line a try because of the huge Development communities that follow them...but more and more as the competition is improving, I'm starting to think the Nexus is no longer for me.
Samsung, HTC and Sony are really stepping up there games. As long as the phone is popular (like the HTC One X, One S, Note N7000, S3, which I've owned them all), you have so much more in options with usually better hardware it seems. I've owned the Nexus S, the Galaxy Nexus, and now the Nexus 4, and ended up flipping them all for other phones for various reasons.
I liked the Nexus 4. It's a great value for pure horsepower, but it lacks a lot of things other phones can give me with similar performance. I still think the HTC One X (S4/225) is the best phone I've ever owned. Other than being limited to 16GB (Which is a non issue for me, 16GB is fine for me so this isn't an issue for all), it was pretty much the perfect Android experience. It has the audio hardware, it has the top tier level camera, Sense 4+ is super smooth and fast with a lot of nice options... and when I want to go back to AOSP, I can flash a rom in 5 minutes to accomplish this. This phone can be bought for less than a Nexus 4 now in excellent condition, with a big XDA community.
I'm hoping the S3 will give me an experience similar to the One X did. If it does, I will keep it for a while as I'm ready to settle on one phone for a year or 2. I almost bought the One X+ until I found a deal on the S3 for less money. I own the i9300 International version, so I've got the Quad core S3, but to be honest, the S4/225 gives the same experience 95% of the time currently. By the time it doesn't, I'll probably have a different phone anyways, so the Dual core vs Quad is mute to me. I live in a small city that only has 21 MBPS 4G, no LTE, no plans to this date announced for LTE, so LTE doesn't matter to me.
I know this post is all over the place, but I've owned a lot of phones, and I can say I've generally enjoyed other phones over the Nexus line.