Rightware's Taiji Benchmark for Android

[Bateluer]

https://market.android.com/details?id=com.rightware.tdmm2v10jnifree

It was released for free a couple weeks ago.

Basemark™ ES 2.0 Taiji Free - World’s Leading Mobile Phone Gaming Benchmark

Rightware's Basemark™ ES 2.0 Taiji Free gaming and graphics performance measurement utility is a consumer-version of the mobile industry’s standard graphics benchmarking product. The world’s most widely adopted graphics benchmarking software used by mobile phone manufacturers and semiconductor companies is now available for gamers, game developers and all consumers who want to measure the performance of their devices in the context of gaming and graphics.

Basemark™ ES 2.0 Taiji Free provides a scientifically designed and reliable game scene – Taiji Girl – to test the 3D graphics performance of the embedded device. High-detail 3D content in Taiji Girl generates a workload that taxes OpenGL ES 2.0 implementation in a realistic, visually stunning way. After running the benchmark, users can easily check how the performance of their device compares to other devices with the integrated Power Board online service.

Basemark™ ES 2.0 Taiji Free product and Power Board service are targeted only for consumer and independent media use, and any commercial use is strictly forbidden.

Who's ran it? Its certainly prettier than Quadrant, though it provides fewer details and specifics.

In my tests on the Galaxy Nexus, without root, custom ROM, or over clocking, it scores ~8fps. The older GPU in combination with the 720p screen takes its toll. The Tegra 2's support for ES 2.0 seems poor too, ~5fps.

 

[Patranus]

"scientifically designed" LOL

 

[JeffreyLebowski]

I gave up on benchmarks for phones. I used to be all about getting higher results, but realized, it doesn't matter. I'm not playing FPS on my phone. I'm playing solitaire and Angry Birds while I take a dump. The only other thing the phone is used for is web browsing. I just want to make sure the phone doesn't have jitters or input lag.

 

[Anubis]

ran it just for the hell of it - but i agree with the dude

8.52 - G nexus

4.31 - Droid X

 

[Bateluer]

I gave up on benchmarks for phones. I used to be all about getting higher results, but realized, it doesn't matter.

A good benchmark isn't about getting higher results, its about accurate results that can be compared reliably to other results. Quadrant was so easy to spoof and generate massively inflated scores while real world performance didn't see any benefit.

Its difficult to benchmark phones though because you can't isolate components the way you can on a PC. If I want to bench a graphics card, its easy to test the different cards under the same OS, same CPU, same RAM, and same motherboard, and at the same resolutions. On a phone, there's a myriad of different SoCs, most with different GPUs, different amounts of RAM, and different screen resolutions. The Nexus will perform worse than other phones, for example, because that poor SGX540 has to push 720s-worth of pixels through the test. A Bionic, for example, has clearly slower hardware and less RAM, but would perform better because its display only has a qHD resolution.

I do hope Rightware puts out a 3DMark-esque suite of benchmarks for Android, iOS, and WP7, so we can get the same set of tools across all the mobile platforms.

 

[Raduque]

40.05, Exynos SGS2
18 on myTouch 4G Slide
Friend with an HTC Amaze got 25 (overclocked to 1.5)
Friend with an HTC Sensation 4G got 16

I guess the Adreno 220 really IS that much slower than the Mali400.

 

[poofyhairguy]

34FPS for my SGS2, with just a few stutters. The test is pretty good for testing the GPU I think as when I overclocked to 1.6GHz it only went up to 37FPS.

I used to be all about getting higher results, but realized, it doesn't matter. I'm not playing FPS on my phone.

I mostly disagree with that sentiment. I prefer decent 3D based games over sprite based games. Call it a technology bias, but when my phone can produce better visuals than my last two portable gaming consoles (DS, PSP) I like to get the most out of it I can.

There are many decent and addictive higher-end mobile games. I have been hooked on Shine Runner for a week now, and before that ShadowGun, and before that Cordy, and before that Samurai II: Vengence, etc.

 

[poofyhairguy]

40.05, Exynos SGS2

Oh wow, what kernel and ROM do you use?

 

[ChronoReverse]

15FPS 1024x768 HP Touchpad. Looks like it doesn't have an offscreen render mode so that this can be comparable across different screen resolutions.

 

[Raduque]

Oh wow, what kernel and ROM do you use?

Unnamed 2.2.1 and whatever kernel it comes with.

I just ran it 3 more times and got 31, 35, and 34.8. I should've taken a screenshot.

 

[Dulanic]

Unnamed 2.2.1 and whatever kernel it comes with.

I just ran it 3 more times and got 31, 35, and 34.8. I should've taken a screenshot.

I used Unnamed also on the Sprint SGSII and got 36.72. Exynos is a beast overall.

 

[stormkroe]

40.05, Exynos SGS2
18 on myTouch 4G Slide
Friend with an HTC Amaze got 25 (overclocked to 1.5)
Friend with an HTC Sensation 4G got 16

I guess the Adreno 220 really IS that much slower than the Mali400.

According to their database at http://results.rightware.com/site/front_page, the average GS 2 is 27 fps and the EVO 3d/Sensation is 22. Considering the Mali is only 22.7% faster and is doing over 25% LESS work, if we're honest we can at least say they're fairly evenly matched.

 

[ChronoReverse]

Yeah, you have to look at the screen resolution since this benchmark doesn't render off-screen at the same resolution for all devices.

Most of the 220 devices have a higher resolution than the Mali devices.

 

[Raduque]

What about the 18fps result on my myTouch 4G Slide, which is the same resolution and clock speed as the Exynos?

 

[ChronoReverse]

Not sure what's going on there. I get 14.89 with my G2 which has only a lowly Adreno 205.