It would be interesting to see the back fire effect analyzed against hard sciences and see if people change their views on things. The problem is most of the hard sciences that people still have any disagreement on are so advanced the average person would have no hope of understanding it well enough to have an opinion.
Looking at social sciences does create some issues because very few things in social sciences are hard set rules, it is more "this generally happens." Also a ton of social science research is just pure garbage. I say this a someone that has done my own research and written research papers. Most of the social science papers I've read have poorly set up experiments, bad underlying assumptions, small non-random samples, abuse statistics then make far sweeping generalizations about the results.
I have had social science papers change my mind when the paper actually supported my original belief, because I realized the thing that originally gave me that belief was based on this research 2nd or 3rd hand and this research is crap.
I think giving people fake research papers, then measuring how it affects their believes could also result in biases. It would be a lot better to give them real research, high-quality papers that disagree with them and see what the result is. Probably even better to look at history facts that are easy to verify as wrong.
That being said, I definitely believe that the backfire effect is real, but you guys are being way too hard on momeNt. I agree with him that just because the backfire effect is real with social sciences doesn't mean it would be real in the hard sciences. I also do believe there are high quality social science papers out there, but there is also a lot of noise too.
Edit: I missed his post where he said he believed scientist couldn't tell you how the brain thinks, I do completely disagree with that.