It's an interesting question. Even a single climber hanging off like that would induce some forces into the rock at an angle to the force of gravity. It seems insignificant at first glance, but after thinking about it some more I come to the conclusion that it is far more likely to be the accumulated effect of the climbing than simple chance.