Originally posted by: ShawnD1
Originally posted by: apoppin
First, what *gamer* in their RIGHT mind give a crap about 800x600 in any modern game?
One that graduated high school?
http://en.wikipedia.org/wiki/D...able#Use_in_statistics
In the design of experiments, an independent variable's values are controlled or selected by the experimenter to determine its relationship to an observed phenomenon (i.e., the dependent variable). In such an experiment, an attempt is made to find evidence that the values of the independent variable determine the values of the dependent variable.
When we're trying to measure raw computing power, CPU is your independent variable, frame rate is your dependent variable, and the game's graphical demand is the extraneous variable.
In the link you provided, the authors admit that they did not account for extraneous variables (ie graphical demands of the game).
your article:
Our gaming tests were performed using a single GeForce GTX 280 graphics card which is almost maxed out at 100% of its capacity
[...]
It appears that the GeForce GTX 280 had run out of legs in F.E.A.R Perseus Mandate at 1920x1200 using its maximum visual settings. Interestingly, the Core 2 Duo E8600 produced the best result here, beating the Core i7 965 EE by a single frame per second, and the slowest processor by just 3fps.
The test they performed is perfectly valid but it's not testing what you think it's testing. What the author is testing is whether or not the CPU is a limitation when your computer is using a GTX 280 graphics card. The varying frame rates in Far Cry 2 show that the CPU is one of the limitations in that game, so if you currently own a GTX280, you will see improvements by getting an i7. The uniform frame rates in Perseus Mandate show that this game is almost entirely limited by the video card, and the author explicitly states this when he says "it appears that the GeForce GTX 280 had run out of legs". What he means is that all of these processors tested still have lots of head room in that game, so upgrading to a GTX 295 would improve the frame rate.
If you want to test raw computing power, you need to eliminate the extraneous variables. Ideally, a gaming CPU test should be done at lowest resolution with the most powerful video card you can find. This completely eliminates the GPU bottleneck and gives us a picture of how fast the processor really is. When you look at something like Far Cry 2 where the game is obviously bottlenecked by both the CPU and the GPU, what does that data tell us? Basically nothing. It might say something like the i7 is 10% faster than a C2Q, but a completely CPU-bound test will show the i7 is maybe 20-30% faster. Simply put, doing a high resolution test is a complete waste of time.