You are forcing them to pay for the infrastructure, then claiming that because they have to use the infrastructure they paid for, they must continue to pay for it. The "resources" that gave them that foundation were their own, or those of a previous generation. "Society" does not generate any resources. At best, it can simply pool them together for the common good.
Forcing them? As opposed to what, heading off into the forest and using stone tools to make their own Center for Innovation by hand? You need to get past this fantasy that you or anyone else is self-made. Everything you are and have was built upon those who came before you, using America's extraordinary physical, financial, and educational infrastructure (substituting other countries as appropriate for other people).
We don't see meaningful innovation coming from aboriginal tribes using hand-made stone tools. It comes from people people who leverage the benefits of a developed society to push forward. It comes from people who can take for granted things like electricity, clean water, plentiful safe food, roads, housing, education, banks, merchants, public safety, etc., so they can focus on creating the next big thing instead of scrounging for grubs for dinner.
Even more, turning that idea from a pipe dream into a profitable product demands extensive infrastructure support. One needs facilities, utilities, an adequately-educated workforce, suppliers, service providers, public safety and health, transportation, distributors, investors, a legal system with property & IP rights, ... and customers, all of whom are products of and dependent upon the same incredible physical, financial, and educational infrastructure provided by society. Take it away and no matter how brilliant and ambitious you may be, you're just a smart chimpanzee in a loin cloth.
And which side am I beholden to? I have no representation in our government at this point, and I've never been a member of any political party. I don't have a dog in the fight. I simply object to those who claim that their need gives them a right to what I have earned. To be fair, you have made just about the best argument I've seen for why "society" might have some claim to what I've earned, but it still falls apart because society as a whole cannot contribute anything - only its members can.
As an educated person, you surely must understand that "partisan" is not limited to political parties. It can also, for example, refer to ideologies and generally taking sides. In this case, I was referring to your partisan devotion to the myth of the self-made man.