The filibuster was never part of the constitution, or a part of the founding father's vision. It's become the main reason nothing gets done legislation wise, and it's preventing us from moving forward as a nation. There is a reason a party is in the minority, the citizens don't want them in power, and they should not have the power to block the will of the citizens. That all the filibuster is, is a tool used to circumvent the will of the people. What you are afraid of is if the filibuster is removed, your party wouldn't be able to manipulate voting laws, and minority rule. Which is exactly what's been happening for decades.
Of course, if your party actually made policies for the good of the nation, it's citizens, and not for their party and power, things would be different.