ATI made the HardwareAnalysis situation worse

imported_dwalton

Junior Member
Aug 12, 2005
19
0
0
This has to be the most controversial launch of a GPU since the 5800 Ultra. HardwareAnalysis has certainly created a firestorm by releasing a set of benchmarks that doesn?t show the type of performance one would expect from the new ATI architecture.

The type of reaction to this event is well expected. A hardware site, that wasn?t invited to the ATI R520 launch and isn?t under the NDA, releases R520 benchmarks that weren?t done in house and shows the R520 in a poor light. We all know that more than a few NVIDIA loyalists would use this as fanboy fodder, while at the same time some ATI loyalists would slander the hardware site and the writer of the article and call its benchmarks ?fake?. In other words, the response was rather typical.

The more neutral fans of NVIDIA/ATI took these benchmarks with a grain of salt. Benchmarks from one source, no matter how scientific it was done or how much we trust the site, can never be weighed alone. Benchmarks from a number of different trusted sites should be used to make a valid judgment. We all know that mistakes are made and that issues are often overlooked when our trusted hardware site are rushing to produce performance articles to be released as soon as the NDA expired. It can be assumed that more errors can be introduced when product comparisons are made by two different testers (with each tester testing only one of the competing products but not both) and using two different test beds (this is the case with HA benchmark review). Our opinion of the R520 performance should not be swayed by these benchmarks, simply because we cannot form an honest unbiased opinion until more data is in hand.

While the graphics community?s reaction to the pre-released benchmarks would well expected, ATI?s was not. The problem with this fiasco isn?t the so-called R520 benchmarks, but ATI?s response to them. Their statements and their handling of the situation have compounded the doubts created by the benchmarks. While I expected a statement from ATI, I thought I would be reading something like this:

?Dear So and So Readers,

While we understand that HA has not signed an NDA and is no way bound by its restriction. Furthermore, the production of pre-release benchmarks of R520 would be newsworthy event for any non-NDA bound hardware site. However, we do not agree with the questionable benchmarks produced by HA or the dubious conditions in which they were attained. We call into questions the reliability of the benchmarks due to a number of issues.

1.The benchmarks numbers are not indicative of the performance of the X1800XT. The performance testing done in house produces results that contradict the HA?s benchmark numbers.

2. No board partners have access to the R520XT or its specs. We are still in the process of finalizing the specification of the R520XT to ensure that we reach the maximum performance potential of our flagship card. Therefore, with no R520XT or its specification, it is highly improbable for a board partner to reliably produce the performance characteristic of the R520XT.

3. While we cannot prove or disprove Mr. Sander?s account of how these benchmarks were attained. We feel that our business partners would not risk their relationship with ATI just to provide ?performance material? to a largely unknown hardware site.

While we would like to release performance numbers that contradict HA?s analysis of the R520, it would be to the dismay as well as detriment of the trusted hardware sites that are bound by the NDA. Where one of their prominent functions is to provide unbiased and objective performance reviews for many of ATI products. Those sites have agreements with ATI to release no material related to the R520 specifications and performance characteristic in exchange for access to the R520. We expect them to honor the NDA, so we feel that we should honor the Non Disclosure Agreement as well.

Thank you,
So and So
ATI?

However, what we got was statements and other material that would make one believe that the PR team of ATI needs a class in Damage Control 101. While they couldn?t disprove or prove the statements and data given by Mr. Sanders, we ended up hearing statements about ?over-clocked 850XT, we think?. We were given the gist of a bunch of email fodder that cast doubts Mr. Sanders? character. However, those gists don?t even show circumstantial evidence that might make one conclude that Mr. Sanders may have concocted that data. It is just mostly used as a tool of character assassination. This tactic gives credibility to Mr. Sander?s assertion all along, that ATI doesn?t play kindly to those who write unflattering articles of ATI products. ATI response seems very desperate, vindictive and unprofessional. Instead of limiting the damage caused by the unflattering pre-released benchmarks, ATI fueled the flame.

This controversial article would have died smoldering death with a very simple and professional response saying it doesn?t believe that these benchmarks can be used to determine the performance potential of the R520XT. Nevertheless, ATI response has insured that HA?s articles will a topic of conversations in a lot of community forums until after the expiration of the NDA. Also, ATI has left themselves in difficult spot. If by some chance, these benchmarks are true, ATI will probably lose a lot of credibility in the eyes of the consumers.

Disclaimer: This view is not to disparage the R520 or any other ATI product or levy an opinion of whether the 7800 will be better than the R520 or vice versa. This is again is just something I'm doing to fill the time until we see if the R520 is the glorious return of the 9700, a 5800 in disguise or something in between.
 

ArchAngel777

Diamond Member
Dec 24, 2000
5,223
61
91
Originally posted by: dwalton
This has to be the most controversial launch of a GPU since the 5800 Ultra. HardwareAnalysis has certainly created a firestorm by releasing a set of benchmarks that doesn?t show the type of performance one would expect from the new ATI architecture.

The type of reaction to this event is well expected. A hardware site, that wasn?t invited to the ATI R520 launch and isn?t under the NDA, releases R520 benchmarks that weren?t done in house and shows the R520 in a poor light. We all know that more than a few NVIDIA loyalists would use this as fanboy fodder, while at the same time some ATI loyalists would slander the hardware site and the writer of the article and call its benchmarks ?fake?. In other words, the response was rather typical.

The more neutral fans of NVIDIA/ATI took these benchmarks with a grain of salt. Benchmarks from one source, no matter how scientific it was done or how much we trust the site, can never be weighed alone. Benchmarks from a number of different trusted sites should be used to make a valid judgment. We all know that mistakes are made and that issues are often overlooked when our trusted hardware site are rushing to produce performance articles to be released as soon as the NDA expired. It can be assumed that more errors can be introduced when product comparisons are made by two different testers (with each tester testing only one of the competing products but not both) and using two different test beds (this is the case with HA benchmark review). Our opinion of the R520 performance should not be swayed by these benchmarks, simply because we cannot form an honest unbiased opinion until more data is in hand.

While the graphics community?s reaction to the pre-released benchmarks would well expected, ATI?s was not. The problem with this fiasco isn?t the so-called R520 benchmarks, but ATI?s response to them. Their statements and their handling of the situation have compounded the doubts created by the benchmarks. While I expected a statement from ATI, I thought I would be reading something like this:

?Dear So and So Readers,

While we understand that HA has not signed an NDA and is no way bound by its restriction. Furthermore, the production of pre-release benchmarks of R520 would be newsworthy event for any non-NDA bound hardware site. However, we do not agree with the questionable benchmarks produced by HA or the dubious conditions in which they were attained. We call into questions the reliability of the benchmarks due to a number of issues.

1.The benchmarks numbers are not indicative of the performance of the X1800XT. The performance testing done in house produces results that contradict the HA?s benchmark numbers.

2. No board partners have access to the R520XT or its specs. We are still in the process of finalizing the specification of the R520XT to ensure that we reach the maximum performance potential of our flagship card. Therefore, with no R520XT or its specification, it is highly improbable for a board partner to reliably produce the performance characteristic of the R520XT.

3. While we cannot prove or disprove Mr. Sander?s account of how these benchmarks were attained. We feel that our business partners would not risk their relationship with ATI just to provide ?performance material? to a largely unknown hardware site.

While we would like to release performance numbers that contradict HA?s analysis of the R520, it would be to the dismay as well as detriment of the trusted hardware sites that are bound by the NDA. Where one of their prominent functions is to provide unbiased and objective performance reviews for many of ATI products. Those sites have agreements with ATI to release no material related to the R520 specifications and performance characteristic in exchange for access to the R520. We expect them to honor the NDA, so we feel that we should honor the Non Disclosure Agreement as well.

Thank you,
So and So
ATI?

However, what we got was statements and other material that would make one believe that the PR team of ATI needs a class in Damage Control 101. While they couldn?t disprove or prove the statements and data given by Mr. Sanders, we ended up hearing statements about ?over-clocked 850XT, we think?. We were given the gist of a bunch of email fodder that cast doubts Mr. Sanders? character. However, those gists don?t even show circumstantial evidence that might make one conclude that Mr. Sanders may have concocted that data. It is just mostly used as a tool of character assassination. This tactic gives credibility to Mr. Sander?s assertion all along, that ATI doesn?t play kindly to those who write unflattering articles of ATI products. ATI response seems very desperate, vindictive and unprofessional. Instead of limiting the damage caused by the unflattering pre-released benchmarks, ATI fueled the flame.

This controversial article would have died smoldering death with a very simple and professional response saying it doesn?t believe that these benchmarks can be used to determine the performance potential of the R520XT. Nevertheless, ATI response has insured that HA?s articles will a topic of conversations in a lot of community forums until after the expiration of the NDA. Also, ATI has left themselves in difficult spot. If by some chance, these benchmarks are true, ATI will probably lose a lot of credibility in the eyes of the consumers.

Disclaimer: This view is not to disparage the R520 or any other ATI product or levy an opinion of whether the 7800 will be better than the R520 or vice versa. This is again is just something I'm doing to fill the time until we see if the R520 is the glorious return of the 9700, a 5800 in disguise or something in between.


Little friendly advice... Ready? Here it is... There are already about 15 topics on this issue in these forums alone. You might want to post this in an already active thread.
 

crazydingo

Golden Member
May 15, 2005
1,134
0
0
Originally posted by: dwalton
The issue isn't the legitimacy of the benchmark but ATI handling of it.
You should probably search up all the threads and read. One member did a good job of what ATI could have done (even what you suggested here) but he did better job in his reasoning.
 
Jun 14, 2003
10,442
0
0
Originally posted by: JonnyBlaze
i didnt read any of that but the benchmarks are fake.


hold on a sec mr blaze

nobody actually knows, ATI say fake, sanders pretty much says real, its their word against his, and theres no proof from either side. sanders because he didnt actually bench the card, and ATI because of NDA.

please dont put anything regarding R520 performance as Fact because there is no proof to back it up
 
Apr 17, 2003
37,622
0
76
Originally posted by: otispunkmeyer
Originally posted by: JonnyBlaze
i didnt read any of that but the benchmarks are fake.


hold on a sec mr blaze

nobody actually knows, ATI say fake, sanders pretty much says real, its their word against his, and theres no proof from either side. sanders because he didnt actually bench the card, and ATI because of NDA.

please dont put anything regarding R520 performance as Fact.


i would think the burden of proof lies on Sanders shoulders as he is claiming to have numbers for a card that he does not posses nor provide any proof that his "partners" have the card

in other words, there is reasonable doubt about the legitimacy of how the numbers were produced and thus Sanders gets burden
 
Apr 17, 2003
37,622
0
76
Originally posted by: dwalton
This has to be the most controversial launch of a GPU since the 5800 Ultra. HardwareAnalysis has certainly created a firestorm by releasing a set of benchmarks that doesn?t show the type of performance one would expect from the new ATI architecture.

The type of reaction to this event is well expected. A hardware site, that wasn?t invited to the ATI R520 launch and isn?t under the NDA, releases R520 benchmarks that weren?t done in house and shows the R520 in a poor light. We all know that more than a few NVIDIA loyalists would use this as fanboy fodder, while at the same time some ATI loyalists would slander the hardware site and the writer of the article and call its benchmarks ?fake?. In other words, the response was rather typical.

The more neutral fans of NVIDIA/ATI took these benchmarks with a grain of salt. Benchmarks from one source, no matter how scientific it was done or how much we trust the site, can never be weighed alone. Benchmarks from a number of different trusted sites should be used to make a valid judgment. We all know that mistakes are made and that issues are often overlooked when our trusted hardware site are rushing to produce performance articles to be released as soon as the NDA expired. It can be assumed that more errors can be introduced when product comparisons are made by two different testers (with each tester testing only one of the competing products but not both) and using two different test beds (this is the case with HA benchmark review). Our opinion of the R520 performance should not be swayed by these benchmarks, simply because we cannot form an honest unbiased opinion until more data is in hand.

While the graphics community?s reaction to the pre-released benchmarks would well expected, ATI?s was not. The problem with this fiasco isn?t the so-called R520 benchmarks, but ATI?s response to them. Their statements and their handling of the situation have compounded the doubts created by the benchmarks. While I expected a statement from ATI, I thought I would be reading something like this:

?Dear So and So Readers,

While we understand that HA has not signed an NDA and is no way bound by its restriction. Furthermore, the production of pre-release benchmarks of R520 would be newsworthy event for any non-NDA bound hardware site. However, we do not agree with the questionable benchmarks produced by HA or the dubious conditions in which they were attained. We call into questions the reliability of the benchmarks due to a number of issues.

1.The benchmarks numbers are not indicative of the performance of the X1800XT. The performance testing done in house produces results that contradict the HA?s benchmark numbers.

2. No board partners have access to the R520XT or its specs. We are still in the process of finalizing the specification of the R520XT to ensure that we reach the maximum performance potential of our flagship card. Therefore, with no R520XT or its specification, it is highly improbable for a board partner to reliably produce the performance characteristic of the R520XT.

3. While we cannot prove or disprove Mr. Sander?s account of how these benchmarks were attained. We feel that our business partners would not risk their relationship with ATI just to provide ?performance material? to a largely unknown hardware site.

While we would like to release performance numbers that contradict HA?s analysis of the R520, it would be to the dismay as well as detriment of the trusted hardware sites that are bound by the NDA. Where one of their prominent functions is to provide unbiased and objective performance reviews for many of ATI products. Those sites have agreements with ATI to release no material related to the R520 specifications and performance characteristic in exchange for access to the R520. We expect them to honor the NDA, so we feel that we should honor the Non Disclosure Agreement as well.

Thank you,
So and So
ATI?

However, what we got was statements and other material that would make one believe that the PR team of ATI needs a class in Damage Control 101. While they couldn?t disprove or prove the statements and data given by Mr. Sanders, we ended up hearing statements about ?over-clocked 850XT, we think?. We were given the gist of a bunch of email fodder that cast doubts Mr. Sanders? character. However, those gists don?t even show circumstantial evidence that might make one conclude that Mr. Sanders may have concocted that data. It is just mostly used as a tool of character assassination. This tactic gives credibility to Mr. Sander?s assertion all along, that ATI doesn?t play kindly to those who write unflattering articles of ATI products. ATI response seems very desperate, vindictive and unprofessional. Instead of limiting the damage caused by the unflattering pre-released benchmarks, ATI fueled the flame.

This controversial article would have died smoldering death with a very simple and professional response saying it doesn?t believe that these benchmarks can be used to determine the performance potential of the R520XT. Nevertheless, ATI response has insured that HA?s articles will a topic of conversations in a lot of community forums until after the expiration of the NDA. Also, ATI has left themselves in difficult spot. If by some chance, these benchmarks are true, ATI will probably lose a lot of credibility in the eyes of the consumers.

Disclaimer: This view is not to disparage the R520 or any other ATI product or levy an opinion of whether the 7800 will be better than the R520 or vice versa. This is again is just something I'm doing to fill the time until we see if the R520 is the glorious return of the 9700, a 5800 in disguise or something in between.


so are you saying ATi's "strong arm" response implicates them????
 
Jun 14, 2003
10,442
0
0
Originally posted by: Corporate Thug
Originally posted by: otispunkmeyer
Originally posted by: JonnyBlaze
i didnt read any of that but the benchmarks are fake.


hold on a sec mr blaze

nobody actually knows, ATI say fake, sanders pretty much says real, its their word against his, and theres no proof from either side. sanders because he didnt actually bench the card, and ATI because of NDA.

please dont put anything regarding R520 performance as Fact.


i would think the burden of proof lies on Sanders shoulders as he is claiming to have numbers for a card that he does not posses nor provide any proof that his "partners" have the card

in other words, there is reasonable doubt about the legitimacy of how the numbers were produced and thus Sanders gets burden


now that you put it like that i can see what you mean.

but ATI's come back surely carrys just as much doubt. i mean its their product theyre gonna big it up no matter what, they say its going to be better, but then again you dont say that your companies solution sucks the big one before its released do you.

i think both arguements would blow away in a light breeze.....theres just no substance behind them. and it seems more about a disgruntled sanders being dropped by ati than it does about the new hardware.
 
Apr 17, 2003
37,622
0
76
Originally posted by: otispunkmeyer
Originally posted by: Corporate Thug
Originally posted by: otispunkmeyer
Originally posted by: JonnyBlaze
i didnt read any of that but the benchmarks are fake.


hold on a sec mr blaze

nobody actually knows, ATI say fake, sanders pretty much says real, its their word against his, and theres no proof from either side. sanders because he didnt actually bench the card, and ATI because of NDA.

please dont put anything regarding R520 performance as Fact.


i would think the burden of proof lies on Sanders shoulders as he is claiming to have numbers for a card that he does not posses nor provide any proof that his "partners" have the card

in other words, there is reasonable doubt about the legitimacy of how the numbers were produced and thus Sanders gets burden


now that you put it like that i can see what you mean.

but ATI's come back surely carrys just as much doubt. i mean its their product theyre gonna big it up no matter what, they say its going to be better, but then again you dont say that your companies solution sucks the big one before its released do you.

i think both arguements would blow away in a light breeze.....theres just no substance behind them. and it seems more about a disgruntled sanders being dropped by ati than it does about the new hardware.


to be honest, i am surprised about the amount of attention that ATi has given to the issue. i would expect something along the lines of "well just let our numbers do our talking for us once the NDA has expired"

i'm not exactly sure why they would dedicate so much effort in discounting Sanders...
 

imported_dwalton

Junior Member
Aug 12, 2005
19
0
0
Originally posted by: crazydingo
Originally posted by: dwalton
The issue isn't the legitimacy of the benchmark but ATI handling of it.
You should probably search up all the threads and read. One member did a good job of what ATI could have done (even what you suggested here) but he did better job in his reasoning.

can you elaborate with the reasoning part and while you are at will you please give your take on this aspect of the controversy :)

While searching and reading up on all the post may be an option. Its a little hard to read through all the flames just to get at the more interesting aspects of the situation. The purpose of the post is to attract AT forums members who have something more to say then "they fake" or "the R520 sucks".
 

imported_dwalton

Junior Member
Aug 12, 2005
19
0
0
"so are you saying ATi's "strong arm" response implicates them????"

No, what I'm saying is ATI's PR team made the situation worse and put fuel on fire. They basically went into a flame war with Mr. Sanders.
 

crazydingo

Golden Member
May 15, 2005
1,134
0
0
Originally posted by: Corporate Thug
to be honest, i am surprised about the amount of attention that ATi has given to the issue. i would expect something along the lines of "well just let our numbers do our talking for us once the NDA has expired"

i'm not exactly sure why they would dedicate so much effort in discounting Sanders...
ATI was intent to keep silent over the article and the rukkus people were making after realising Sander's numbers dont add up. ATI stepped in when Sanders started signing up across many boards and trying to twist his relationship with ATI. He also removed and edited his article (to cover up more holes) in the mean time.
 

imported_dwalton

Junior Member
Aug 12, 2005
19
0
0
Originally posted by: Corporate Thug
Originally posted by: otispunkmeyer
Originally posted by: JonnyBlaze
i didnt read any of that but the benchmarks are fake.


hold on a sec mr blaze

nobody actually knows, ATI say fake, sanders pretty much says real, its their word against his, and theres no proof from either side. sanders because he didnt actually bench the card, and ATI because of NDA.

please dont put anything regarding R520 performance as Fact.


i would think the burden of proof lies on Sanders shoulders as he is claiming to have numbers for a card that he does not posses nor provide any proof that his "partners" have the card

in other words, there is reasonable doubt about the legitimacy of how the numbers were produced and thus Sanders gets burden


Whether these benchmarks are fake or not, we will find out the truth once the NDA is lifted. The more interesting question is what are the ramification to ATI if these numbers are true. They went out of their way to lambast the guy and his data.

We all know what will happen to Mr. Sanders if these numbers are false. He will lose all credibility and his site will probably disappear into hardware site graveyard.

But if they are true?

Will you feel a tinge of pessimism when ATI talks up any future products. When ATI is late to the ball game with Nvidia releasing a performance pleasing product, will you play the wait and see game or just buy nvidia?
 

johnnqq

Golden Member
May 30, 2005
1,659
0
0
i didn't read those 15 threads because they're full of ati hating...all i know is that the benchmarks were fake and some guy from ati posted on his forums that he was wrong. (am i close?)

look. ati is a huge fvcking company, whether you like them or not. unless only a few guys screwed up in misleading the public, i'm 99% sure that i can trust ati. i would feel the same way for nvidia.
 

reever

Senior member
Oct 4, 2003
451
0
0
Omg this thread is so true! Thank you for spreading so much light on the situation dwalton, seriously, thanks
 

imported_dwalton

Junior Member
Aug 12, 2005
19
0
0
Originally posted by: johnnqq
i didn't read those 15 threads because they're full of ati hating...all i know is that the benchmarks were fake and some guy from ati posted on his forums that he was wrong. (am i close?)

look. ati is a huge fvcking company, whether you like them or not. unless only a few guys screwed up in misleading the public, i'm 99% sure that i can trust ati. i would feel the same way for nvidia.

If I gave you the choice of either giving you the 7800GTX or X1800XT (if you did not own the 7800GTX already) today or the day after the NDA was lifted. Which day would you choose? I don't think many of us would choose today.

AT's Performance Reviews would be un-necessary if everyone brought products based on trust.
 

mdchesne

Banned
Feb 27, 2005
2,810
1
0
Originally posted by: ArchAngel777


Little friendly advice... Ready? Here it is... There are already about 15 topics on this issue in these forums alone. You might want to post this in an already active thread.

bueno. finally, the beginning of the end of uni-subject, multi-postings
 

ddogg

Golden Member
May 4, 2005
1,864
361
136
omg...there must be about 10 threads on this subject!! a true drama!