4 Samsung and 2 HTC devices delisted at Furmark

ShintaiDK

Lifer
Apr 22, 2012
20,378
145
106
http://vr-zone.com/articles/delisted-futuremark-cracks-samsung-htcs-benchmark-cheating/65036.html

Due to CPU and GPU clock cheating.

It was discovered that these devices had a line of code that automatically clocked the CPU and GPU to maximum whenever a known benchmark utility was initialized. This allowed manufacturers to post a 20 percent higher benchmark score than what a device would actually get in real-world usage.

Benchmarks-1024x474.png


I wonder if there will be more.
 

thilanliyan

Lifer
Jun 21, 2005
12,045
2,261
126
Do people really buy cell phones based on benchmarks?

A video card or CPU I can understand looking at benchmarks, but a phone? I personally don't know anyone who has even mentioned "benchmark" in the same sentence as their phone.
 

blackened23

Diamond Member
Jul 26, 2011
8,548
2
0
No, only a few people buy phones based on benchmarks. With that being the case, Samsung should not be dishonest in their phone performance, either, period. The relevance of benchmarks matter to a certain percentage of users, and to those folks samsung is outright misrepresenting their product.

It's all about principle. Even though I love their products, the bottom line is that Samsung is cheating. That is pretty F'ed up.
 

ChronoReverse

Platinum Member
Mar 4, 2004
2,562
31
91
snapdragon >> exynos and even samsung know it

Erm, 4 of the six devices are Snapdragon (including 2 Samsung phones).

This is simply just cheating to look better.

It's all about principle. Even though I love their products, the bottom line is that Samsung is cheating. That is pretty F'ed up.
Should mention HTC too, they're both cheating. I wonder if any of the other vendors have more subtle (or simply not-sufficiently effective) cheating.
 

KingFatty

Diamond Member
Dec 29, 2010
3,034
1
81
Why can't the phones just detect a high CPU load, and then increase the CPU speed? It would be agnostic and not care about a specific name of an executed app, and would increase performance on-demand?
 

24601

Golden Member
Jun 10, 2007
1,683
40
86
Why can't the phones just detect a high CPU load, and then increase the CPU speed? It would be agnostic and not care about a specific name of an executed app, and would increase performance on-demand?

They want to have their cake and eat it too. Meaning battery life tests.
 

Cerb

Elite Member
Aug 26, 2000
17,484
33
86
Why can't the phones just detect a high CPU load, and then increase the CPU speed? It would be agnostic and not care about a specific name of an executed app, and would increase performance on-demand?
They do exactly that, but then throttle back down. The GPU speeds are a bit more murky, but for CPU, they typically use the ondemand governor, which is the default for most PC Linux distros, too. It detects a load, spikes the CPU speed, and then decreases speed a bit, slowly, to try to find a good balance (eventually going into the lowest active idle state allowed, if the load is low enough). I changed mine to MSM-DCVS, which is made to rapidly change power states on Snapdragons, scaling up and down as needed. It got much better standby life, but smoothness in the main UI, and some programs, weren't as good as with the default governor. I went back to the default governor*. TANSTAAFL.

On Windows, the "passive" CPU policy is more or less equivalent to the "conservative" governor in Linux, and "active" similar to the "ondemand" governor. Then, much like with major OEM notebooks, the maker of the phone has one or more utilities to further tweak the policy to improve the experience just for that hardware, or has tweaked the kernel source code towards that end. Those teaks are basically implementing how aggressive the policy should be enforced, and sometimes use alternate implementations of the speed changing itself, to improve perceived UI performance on that hardware with that GUI on top of it.

In general, they try to allow high-CPU/GPU bursts, so long as the device doesn't stay at 100%, because then the phone might overheat, or just eat battery too quickly. FI, if you need 100% CPU and then GPU at the max power state to render a webpage, fine. It'll be over quickly, and then can slow back down for a second or two. They need to keep the average reasonable.

* If you want your phone to really underperform, change the governor for core 0, and then forget to change it for any other cores! :)