SPECInt 2017 scores for ARM Cores (a76, a72, a57etc)

[sgudla]

Hi All,

I am trying to find the SPECInt (2017 or 2006) scores for ARM cortex A76, A72, A57. Any direction would be of great help!

 

[tamz_msc]

Anandtech has 2006 scores for various SoCs. For example check their iPhone XS review.

 

[Nothingness]

Here for instance : https://www.anandtech.com/show/13786/snapdragon-855-performance-preview/2

 

[Andrei.]

Yea these are my latest: https://images.anandtech.com/doci/13786/SPECperf-Jan2019.png

I'll have 2017 scores over the next few months, this release (855, 9820) I'm still going with 2006.

 

[insertcarehere]

Yea these are my latest: https://images.anandtech.com/doci/13786/SPECperf-Jan2019.png

I'll have 2017 scores over the next few months, this release (855, 9820) I'm still going with 2006.

Thanks! Given how formidable recent ARM cores have become, any chance of a comparison between these ARM SoCs/cores vs various x86 cores to see how they match up in specint/specfp in both performance and efficiency?

 

[Thala]

I also would be interested in architectural performance efficiency - aka IPC - like Spec/MHz in relation to various x86 cores.

 

[Andrei.]

Ian started putting some x86 cores into Bench: https://www.anandtech.com/bench/CPU-2019/2523 It's missing the higher clocked Intel parts right now.

You can 1:1 compare these to my mobile figures, LLVM compiler/libc++ with reasonable flags.

I'll be doing a larger scale article this summer, I'm just very busy with the mobile stuff atm.

 

[tamz_msc]

You can 1:1 compare these to my mobile figures, LLVM compiler/libc++ with reasonable flags.

That'd mean just those instances where Clang was the compiler, or all of them?

 

[sgudla]

Yea these are my latest: https://images.anandtech.com/doci/13786/SPECperf-Jan2019.png

I'll have 2017 scores over the next few months, this release (855, 9820) I'm still going with 2006.

Thank you for the quick reply and direction.
I recently bought the license for SPEC CPU 2017 benchmarks and I cross compiled these benchmarks to ARM binaries. I wanted to ask if or how can we run these Spec binaries on a Mobile Phone to generate SPEC results? Could you please tell me how are you generating these scores?

 

[Andrei.]

I wanted to ask if or how can we run these Spec binaries on a Mobile Phone to generate SPEC results?

You can't, they're not compatible.

Could you please tell me how are you generating these scores?

You need to port the benchmarks over to Android/iOS as well as create a new runtime harness.

 

[Thala]

You can't, they're not compatible.You need to port the benchmarks over to Android/iOS as well as create a new runtime harness.

What runtime support interfaces/libraries are the SPEC benchmarks dependent on aside from C-library?

 

[Andrei.]

What runtime support interfaces/libraries are the SPEC benchmarks dependent on aside from C-library?

I mean the execution harness that launches the benchmarks.

 

[Thala]

I mean the execution harness that launches the benchmarks.

Ok thanks, understood.

 

[sgudla]

Here for instance : https://www.anandtech.com/show/13786/snapdragon-855-performance-preview/2

Thank you for the reply.
In this web page, in the first graph the spec speed performance number for snapdragon 855 is 37.07 for SPEC 2006

If I am not wrong this number is calculated by calculating the ratio ( time on a reference machine / time on the System under test ) for all the benchmarks in the suit and the all the ratios are averaged out using geometric mean. (as stated in https://www.spec.org/cpu2017/Docs/overview.html -- Q15)

My question here is - for the "time on reference machine" for SPEC CPU 2006 is "Ultra Enterprise 2 296 MHz UltraSPARC II processor" used ? if yes is there any place where i can find the reference time for all the individual benchmarks? If no, what is the reference machine used and where can i find those reference times.

 

[Andrei.]

37.07 is the SPECfp2006 score.

The reference times are fixed, they're in the sources / your harness ISO. Here's from my harness:

 

[sgudla]

You can't, they're not compatible.You need to port the benchmarks over to Android/iOS as well as create a new runtime harness.

Thank you for the reply.
I did some search on how to port the benchmarks or what a run time harness means but had no much luck. Could you please direct me on how to port the benchmarks and how to create a run time harness to execute these benchmarks.
PS: i am a newbie and trying/understanding how to do this for the first time. Thank you in advance for your patience.