I am fine looking at the totality of his character - I have an issue with you. You're so blithely dismissive of issues that other people who have ancestors who were directly harmed by Washington and many of the other FFs. It's never about the vandalism - that's merely an end result of a racist society shoving its collective fingers in its ears and screaming "lalala" when anyone brings up legitimate points about why we may consider adjusting our insane worship of the FFs. Who we put monuments up to is a reflection of what we value. You may be dismissive of his slave owning, but many see being a slaver as an integral part to who he was: it gave him economic power and he didn't exactly put a stop to his own use of the institution. He may have allegedly struggled with the notion of owning people, but that didn't stop him from continuing to do it, use his power over them to advance his own interests, and chase down people who escaped from bondage. You know what they say - talk is cheap.
As for the idea that he and his wife freed the slaves after death, perhaps you should revisit that assertion:
https://www.history.com/news/did-george-washington-really-free-mount-vernons-slaves
And it's not just black people who might take issue with some of the godlike worship of the FFs. Take the indigenous peoples of the US - for hundreds of years, white people waged a nearly unending campaign of terror against them. I'm sure they are thrilled that the faces of their oppressors are carved into their a mountain located on what they considered sacred ground.