Tolls are used for people to cover what they refuse to have their overall taxes do. It is just a pin point tax to pay for greater efficiency.
With the exception of a few places in the country, everything that has a toll has an alternate. May not be as convenient, but it exists.
Consider rail an alternative to the toll roadway. You chose to use it for the convenience and efficiency and also getting rewarded with a tax break for doing so.
A special roadway with tolls is fine - you have the choice to use it. but to pay the toll and then ask some else to pay you for using the toll road is not correct.