The really fascinating thing about this question to me is both the range of opinions and the difficulty of choosing among them one that seems the best. On the one hand it looks, sounds really bad and on the other no big deal at all. My best guess is that this isn't so much an absolute moral question, but a case of not knowing how you feel. I have no real way on knowing for sure except through whatever insight I might have from looking at myself, but I'd guess that what could have happened is that you woke up enraged. However, because we all have been through a very deep conditioning not to express violent anger you stuffed it on the spot. You spoke of feeling fear of how your husband can react and how you are careful in how you talk to him. These are all vital skills in trying to meet other people with out adult to their adult, the inability to express pure rage, contempt and hate for another whom we also love means the feelings go under ground where they produce things like obsessive thinking and an inability to move on. Since I don't know you or your husband personally, the dynamics and history of your relationship except in insignificant detail and can't know how much of such feelings you're free to express and how much not, I can't really say for sure just how much having to swallow your real reaction could have played a part.
What does concern me a bit is that if you are having to eat your rage, either from external or internal pressure, your reaction to events will not be clean. They will pick up and carry the feelings that are being suppressed. What that could mean as just one of any number of examples is that if your husbands actions were caused by X and you feel unconsciously they were caused by your rage tainted Y then you will be looking for him to confess to Y and not X. You will be wanting him to eat Y, the anger you did not express. I find that especially troubling because you mentioned how he and his family have a history of abuse which they slough off and minimize. He would be an easy target to tar with having an inappropriate or sinister impulse. The whole thing could be maybe just as simple as oops, well I can't try that anymore. I don't know for sure about that, naturally, that could be my own sexism or bias at play, but as I try to put myself in his shoes I can't imagine how I could come to terms with the notion I had committed some really horrid crime. But then my problem could be that I'm sick just like him. Fascinating. I don't know how to know.