Thats not a big deal for me as honestly if i had to use it it would probably be more in a fire a shot to get them ducking around the corner then bolting for the door over sitting and having a shot out trying to kill them. My house is fortunate in that i have a outside door in my bedroom so 1 shot from the 357 and i doubt the person is sitting in the doorway any longer so 1 or 2 more shots and the door is open and im running. Anyways that is my personal theory on it. Sort of why im not to worried about revolver vs semi-auto's with larger rounds. I sure dont plan to sit and shoot all 10 rounds then go for the door.
Call me a pussy for it but i have no desire to sit and kill an intruder but rather see the gun as a method of holding him back for me and loved one to get out. Of course if i do hit him in the dark then all the better

And obviously im lucky in my house layout to have a quick escape method. Unlike my parents who would be in a shootout as they sleep on the third floor.
Granted the 357 mag is worse, two things for me
personally come to mind. First is if i have to use it in self defense my hearing isnt the most important thing on my mind. Hearing loss would be better than being killed. Second I've heard plenty of stories of hearing damage/loss from shooting 45's or 9mm's as well. Granted most of them had ringing for a few hours and thats more or less it. But not fair to say only a 357mag would cause hearing loss either.
And thats my primary reason. im just comfortable with it and know the gun well. I can shoot my brother and my fathers 45 and 40's just fine but i do find myself having to think on how to drop the clip or having to cock the slide. My gun i can just pick it up and fire 6 rounds and reload and do it again without having to think.