Right...maybe
Even the founding fathers never imagined that certain types or classes of people should be qualified to vote. Technically, it wouldn't be a right, but the duty of only the land-holding class of white males. ...and that's how voting has been understood for the longer part of our country's existence.
I think many can agree that plenty of people of voting age, by today's standards...really shouldn't be voting.
After blacks were allowed the right to vote, many states implemented the passing of literacy tests to qualify one for voting. It was eventually deemed unconstitutional. By today's standards of education, I don't think that I would have a problem if we implemented literacy tests again...
Hell, the earliest methods of voting, outside of standing in circles and raising your hand required the voter to accurately spell their candidate's name, and the position for which they were running. any single misspelling (Jon vs John) would invalidate your vote. This lead to part-sponsored pre-made ballots, the paying of "indulgences" to entice the working classes to vote a certain party...all of this eventually evolved into the 2-party system, built on controlling money, power, and long-lasting hegemony of a limited number of ideas over the years.
There is nothing sacred or duty-bound about voting.