You do not want to file those down. That would be a huge pain in the ass.
I like the tape idea. You could get some plastic tubing that could stretch over the pegs that would fill the gap as well... but tape can be customized to the correct thickness more easily.