Bad benchmarks?

[Suspicious-Teach8788]

We're lacking good resolutions here. I know Anandtech likes to use 16x12 and 20x15, but most other sites don't. A lot still stick with 1024x768 => 1600x1200. Then they finally turn on AA, AF. If you look at Hexus you see a straight line performance in a lot of benchmarks, which means you're completely CPU limited in those benchmarks.

Moreover, a lot of reviews are like half done or something (cough Anandtech), and so we can't get a good picture. The X1800XT looks like a pure win on Hexus, but the X1800XL is kinda bleh if we look at HardOCP. If you combine both Hexus and HardOCP and look at Anandtech, the results agree more or less. I do think that the X1800XT is not AS good as Hexus makes it seem as shown by DriverHeaven's review...

Damnit. Why do I have to go to like 8 sites and I'm still not clear which card is the clear winner. The only thing I have been able to deduce was the X1800XL got PWNED by my 7800GT (yes they benched my cool BFG 7800GT OC @ HardOCP), and so I'm happy I made the right purchase.

Somehow I remember the 7800GT benchmarks here weren't even done in morning and didn't have graphs until later and you could see page by page being made. Still it wasn't even a good bench because the 6800GT and X800XL weren't in half the benchmarks since if the 7800GT is supposed to replace those cards, wouldn't you expect those cards to show up?

What's with these new X1800 benchmarks without a 7800GT in half of them and without a 6800Ultra/GT and X850XTPE in half of them either? Come on! These cards are NEW gen cards so they not only compete with NV's cards but compete with their own/NV's previous generation cards that they are supposed to REPLACE....

 

[lifeguard1999]

AT is using 1600x1200 and 2048x1536 to try and put more stress on the GPU to differentiate between the candidates. It is not realistic for most people since most people do not own LCDs or CRTs capable of 2048x1536.

As for the winner, to me it seems to be a tie. The X1800XT wins some benchmarks, loses in others when compared to the 7800 GTX. The real benchmark that it loses is availability.

 

[Suspicious-Teach8788]

Originally posted by: lifeguard1999
AT is using 1600x1200 and 2048x1536 to try and put more stress on the GPU to differentiate between the candidates. It is not realistic for most people since most people do not own LCDs or CRTs capable of 2048x1536.

As for the winner, to me it seems to be a tie. The X1800XT wins some benchmarks, loses in others when compared to the 7800 GTX. The real benchmark that it loses is availability.

You are right. But still we want to figure out which card is faster right? If we all use realistic resolutions we play it, we'll never know which one is really faster or which one scales better....

I just think its bad that we don't have enough charts on AT with enough cards to show the power of either the 7 series or X1800 series. This isn't the first time. Teh 7800GT review was kinda half-assed in my opinion too. I only bought one because I was too eager to get a new card, not that I did a full on research. I somehow thought an X850XTPE could still beat my card until this week when I actually read a full 7800GT review somewhere else.

 

[johnnqq]

somethign is fishy...benchmarks are different on EVERY site (even extremetech). i'll wait for anand and toms to give out benchmarks first.

 

[lifeguard1999]

Originally posted by: DLeRium

Originally posted by: lifeguard1999
AT is using 1600x1200 and 2048x1536 to try and put more stress on the GPU to differentiate between the candidates. It is not realistic for most people since most people do not own LCDs or CRTs capable of 2048x1536.

As for the winner, to me it seems to be a tie. The X1800XT wins some benchmarks, loses in others when compared to the 7800 GTX. The real benchmark that it loses is availability.

You are right. But still we want to figure out which card is faster right? If we all use realistic resolutions we play it, we'll never know which one is really faster or which one scales better....

I just think its bad that we don't have enough charts on AT with enough cards to show the power of either the 7 series or X1800 series. This isn't the first time. Teh 7800GT review was kinda half-assed in my opinion too. I only bought one because I was too eager to get a new card, not that I did a full on research. I somehow thought an X850XTPE could still beat my card until this week when I actually read a full 7800GT review somewhere else.

From ExtremeTech: "When we combine all our benchmarks by taking a geometric mean, we get the following performance comparison:

Single X1800 XT..........Vs. X850 XT..........Vs 7800 GTX
1280x1024..................31% faster............3% faster
1280x1024 4x8x..........53% faster..........15% faster
1600x1200..................39% faster..........3% faster
1600x1200 4x8x..........56% faster..........16% faster

Single X1800 XL..........Vs. X850 XT..........Vs. 7800 GT
1280x1024..................6% faster.............6% slower
1280x1024 4x8x..........15% faster...........Even
1600x1200..................8% faster.............7% slower
1600x1200 4x8x..........14% faster............Even

That gives us a nice summary. I noticed ET benchmarked Serious Sam II (but not FEAR). Cool!

 

[crazydingo]

Good summary, best review I came across so far.

 

[Drayvn]

IS it me or why did Anandtech did use any AA at all for the High end and Ultra high end.

It seems to me in the other sites the X1000 series dont have much of a performance impact like the 7800 does when AA is on

DeLeRium thats probably why you cant see a winner because maybe Anandtech forgot to use AA. When most of the other websites have!

Why did the other sites have like 10 games to review these cards on so we can get a really good perspective on what the performances are like. When AT reviews 4 and then 1 more sometimes.

In DoD and Far Cry and Splinter Cell, what SM are they using, are they using HDR? Have they tried the HDR and AA together? So many questions and faults i can find on these benchmarks.

I had to actually look at the other review sites to find out the performance of the card, and i was shocked that most of them were actually showing the X1800XT and XL to be beating the 7800GTX and GT by quite a margin, the only downers were, Doom 3, DoD and Chronicles of Riddick.

 

[tuteja1986]

Originally posted by: Drayvn
IS it me or why did Anandtech did use any AA at all for the High end and Ultra high end.

It seems to me in the other sites the X1000 series dont have much of a performance impact like the 7800 does when AA is on

DeLeRium thats probably why you cant see a winner because maybe Anandtech forgot to use AA. When most of the other websites have!

Why did the other sites have like 10 games to review these cards on so we can get a really good perspective on what the performances are like. When AT reviews 4 and then 1 more sometimes.

In DoD and Far Cry and Splinter Cell, what SM are they using, are they using HDR? Have they tried the HDR and AA together? So many questions and faults i can find on these benchmarks.

I had to actually look at the other review sites to find out the performance of the card, and i was shocked that most of them were actually showing the X1800XT and XL to be beating the 7800GTX and GT by quite a margin, the only downers were, Doom 3, DoD and Chronicles of Riddick.

yeah i must agree

Anyways i am going to look at updated benchmarking next month when more games come out. I will be looking at :
Call of duty 2 <i didn't like call of duty last quater of the game but i loved the expansion pack and COD2 looks more crazy/awesome and its memory eater as X800XL 512MB could match G70 because it had more memory>
DOD source <loved DOD and i want to see HDR testing>
Elderscroll 4 <should be the best RPG of this year>
BF2 <fav online game>
Farcry <soley for 3.0shader test/65bit>
Quake 4 <loved quake 1 + 3 >
AEO 3 <should be the best RTS of this year>
FEAR <looking like an awesome FPS , suppose to be next Great looking game like HL2/Doom3/Farcry was in its time>

I want a highly detailed article on G70 vs R520 with these benchmark sometime arround next month : )

 

[crazydingo]

I smell a more detailed review coming from AT, atleast I hope.