Originally posted by: dullard
I think you're looking at it the wrong way. Once a PR relationship is quantified in mhz, it should simply scale regardless of what platform the tests are run. You have to simply isolate the external factors that would skew results, such as chipset/platform improvements. If you wanted to run a comparson between the 2 CPUs to make sure the PR rating held up based on the previously identified mhz increase required to justify the PR rating, you would need to run BOTH cpus on the same platform. What you are suggesting is like comparing benchmarks of a GF4 Ti4200 on a KT266 and old drivers to a GF4 Ti4600 on an nForce2 board 8 months later.
But that is exactly what AMD is doing!
Here are some important stats of the computer tested:
2600+ audit
Epox EP-8K3A+ motherboard
256 MB memory
GeForce 4 4600 Ti
Western Digital Caviar WD1200 hard drive
Win XP Pro
2800+ audit
ASUS A7N8X motherboard
256 MB memory
Radeon 9700 128M - Driver 6.13.10.6143
Western Digital Caviar WD1200 hard drive
Win XP Pro service pack 1
3000+ audit
ASUS A7N8X delux motherboard
512 MB memory
Radeon 9700 128M - Driver 6.13.10.6218
Western Digital Caviar WD1200 SE 8MB buffer hard drive
Win XP Pro service pack 1
The average score was 14.7% better comparing the 2800+ to the 2600+. But they changed motherboards to a NForce2 motherboard, updtated the operating system, and put in a better video card. Many games are video card dependant - so how can these scores be even compared? The 2800+ PR is 7.7% higher than the 2600+.
The average score was 10.7% better comparing the 3000+ to the 2800+. But they doubled the memory, used the fastest ATA hard drive available, and used faster video card drivers. I hope you understand what those 3 changes can do to the speed of the programs tested (especially the hard drive on the office benchmarks) - so how can these scores be even compared? The 3000+ PR is 7.1% higher than the 2800+.
How can they tell how much of the performance boost was due to video card/motherboard/memory/operating system/driver changes? They should use the same setup each time!