You can find evil stuff anywhere throughout history and any country/religion if this is what you are focused on during a debate, true. But the turn the other cheek stuff does not make the wheels of civilization turn. It is more of a excuse to forget the big picture.
That said I do not endorse a wholly irreligious society as far as basic philosophy, I think fellowship and caring for your fellow man for a lot of people is not something they find within their best short term interests thus falls to the wayside, if you know of a better plan without having to brainwash/lie/fear/guilt people the world could use it. The sooner the better.
Problem is convincing people to give a shit without having to do any actual work. Humans are generally pretty selfish as a whole when it does not directly benefit us. This is the big paradox of our species that will take many generations to adapt to imo.
But damnit, we made it this far, there are still plenty of caring people not giving up anytime soon.