You could make the same argument about the POTUS. But honestly, you don't have to limit congresscritters to one term apiece. Then what you say would really be a problem. A compromise could be struck where incumbency still holds sway, but it is not indefinite. Say 5 or 7terms in the House and 3 in the Senate. Perhaps you could put a limit on consecutive terms only and allow others to come back. There are plenty of combinations that are potentially better than what we have now.
You're making a misplaced Goldilocks argument - one that's merely 'less bad', by acknowledging that too short of term limits are bad, but defending medium limits.
I think a lot of what's driving the passion for term limits is the feeling that the real issue isn't being solved - that it's 'corrupt politicians for decades, or term limits', no other option.
And in fact, that's probably the best argument for term limits, but it still falls far short by simply being bad for the democracy.
It's based on a fallacy, that the new politicians will be some 'new, uncorrupted faces', when in fact the system will be more enslaved to the money.
People will get even less happy with democracy at all, as it's a total waste that a lot of 'honest' people run and are lost in the mix while the winners are 'selected' by money.
It's hard for people to understand the problem it seems before it happens. When I've posted this before, though, some have responded 'we got term limits, and it was bad'.
Frustration often drive bad policy. We need to take money out, not patch the problem.