<< and even the benchmarks he did run had some extremely dubious results to say the least.
I know very little of CAD benchmarks and applications, which data was extremely dubious? >>
3D Studio Max R3.1 results for one were very unusual, 3D Studio Max often tends to be almost a best case scenario benchmark for the Quadro and yet it was handily beaten by by both the WildCat II 5110, and FireGL4. 3D Studio Max is extremely fond of the Quadro, and it renders Studio Max faster then a WildCat II 5000, Tom has it at almost half the speed of the WildCat II 5110 instead of the more realistic 15% difference one should see.
Tom didnt even mention the fact that the Quadro can maintain real time in the viewport while rendering in 3D Studio Max, while is an awfully big factor in it's favor.
Spec Viewperf is very much a synthetic benchmark, and it's results can tell a lot about potential... but it's seldom an accurate masurement of real world performance. Tom makes no mention of that and almost seems to pass it off as a real world benchmark.
Almost all of his benchmarks were very generic, he didnt even touch upon any specific performance benchmarks focusing on one feature like wireframe manipulation, gouraud shaded models, high polygon loads, structural elements, multiple light sources, phong and smooth blinn shading etc. etc.
Application specific profiles and optimizations in the drivers?
He didnt say a word about whether he used them in some or all of the tests.
All of the cards tested had very specific advantages... for example the FireGL lacks fillrate, but handles complex shading very well, and is incredible at calculating lighting. The FireGL is extremely processor dependent, and doesnt typically associate well with dual processor operation, it scales almost linearly with processor speed though. the FireGL driver team optimizes for anything and everything you can possibly imagine, and they consistently manage to eek out more performance then the hardware base would lead you to believe is possible.
Quadro's gaming roots making it a speed demon at manipulating heavily shaded objects, but is very weak under sustained high polygon loads and has the lowest hardware lighting sources support of any of the common CAD cards. The Quadro has the weakest driver support of any of the common CAD cards, and only has basic application specific optimizations.
The WildCat II's are pure speed in wireframes, and extremely good in CAD style shading, but chokes badly with the more complex shading used in 3D modelling. The WildCat II's put a very low load on the processor, and don't scale well with processor speed, the 3DLabs drivers are well suited for dual processor operation. The low processor utilization allow you to be more productive and keep the system responsive when rendering while other cards would keep the processor very busy.
Tom of course doesnt tel us any of this, nor gives us any benchmarks that really allow us to gauge performance in very specific tasks.
Image quality and rendering accuracy which is often more important then pure speed is not once mentioned.
Perhaps unfortunately he doesnt let on that the powerful T&L engines of many of today's gaming cards enable them to give decent performance in very light CAD scenes.
I'm not sure if the GF3 was available when he did his review but if so I find it unfortunate he doesnt mention that the GF3's flexibility in it's T&L engine often makes it slower for CAD tasks thn the pure brute force GeForce 2, and the GF3's drivers have severe performance discrepancies in many CAD apps. This holds true for the GF3's Quadro varient in the Quadro DCC which is often inferior to the GF2 Pro based Quadro 2 Pro.