Discussion SPEC06/17 IPC vs CB R15 IPC Comparison.

Toggle sidebar Toggle sidebar
N

nicalandia

Diamond Member
Jan 10, 2019
3,330
5,281
136
According to anandtech.com the SPEC suit is the "Go To" bench for IPC testing, but as you can see they have OG Zen beat Skylake IPC, which at the time OG Zen was on par with Broadwell-E and just behind Skylake, They also show Excavator only 44% behind Zen which is about 52% ahead of Excavator in reality.

Here is the SPEC06/17 Chart.

1637674599219.png





Here is the CB R15 just for reference.
www.guru3d.com

Core i9 12900K processor review (Page 7)

Meet Intel's new flagship CPU, the Core i9 12900K. It is based on the Alder Lake architecture and is reviewed here. This time around, Intel was back at the drawing board, creating a completely new ar...
www.guru3d.com www.guru3d.com
1637674735698.png


Another Chart
1637675166913.png

Also there were no IPC improvement from Skylake to Comet Lake.
 
Last edited:
Sort by date Sort by votes
J

JoeRambo

Golden Member
Jun 13, 2013
1,814
2,105
136
Cinebenches are unique in being completely irrelevant to real world performance. I think the most extreme example were those Threadrippers with half of cores not having direct access to memory. They continued to scale almost perfectly in Cinebenches while regressing in performance in quite a few other tests.

Rendering is a niche, and rendering where said rendering is done with tiles that are optimized to mostly fit cores L2 cache and not touch memory has no relation with IPC of actual CPU elsewhere.
There are obviously finer points between Cinebench versions, 15 vs 23 etc that vary in how useless they are.

Anandtech IPC results are meant to be strictly compared to Anandtech benchmark results ONLY. Posting Anandtech IPC and something from other site that is running real world memory config does not reveal anything of value.
But obviously you can still compare "SPEC difference is 10%, but in Anandtech web rendering the difference is 20%"
 
  • Like
Reactions: Etain05, Mopetar, gdansk and 1 other person
Upvote 0 Downvote
J

JoeRambo

Golden Member
Jun 13, 2013
1,814
2,105
136
nicalandia said:
How is Skylake 24% behind Comet Lake in IPC? If anandtech say stock vs stock well isn't IPC supposed to be benched at ISO Speed?
Click to expand...

Memory speeds increased and so did cache. L3 went from 8MB to 20MB and memory speed increased from 2133 to 2933. With the way Anandtech tests at JEDEC timings, cache size and memory speed improvement have oversized impact.
Also compilers have changed, making comparisons of rather dubious value as well.
 
  • Like
Reactions: lightmanek, Schmide and Kryohi
Upvote 0 Downvote
D

Doug S

Platinum Member
Feb 8, 2020
2,252
3,483
136
JoeRambo said:
Cinebenches are unique in being completely irrelevant to real world performance. I think the most extreme example were those Threadrippers with half of cores not having direct access to memory. They continued to scale almost perfectly in Cinebenches while regressing in performance in quite a few other tests.
Click to expand...


Yep, it is the modern equivalent of Dhrystone - only useful for measuring how well stuff that almost never needs to touch RAM will run.
 
  • Like
Reactions: Nothingness
Upvote 0 Downvote
N

nicalandia

Diamond Member
Jan 10, 2019
3,330
5,281
136
Last edited:
  • Like
Reactions: Zucker2k
Upvote -1 Downvote
H

Hitman928

Diamond Member
Apr 15, 2012
5,244
7,792
136
nicalandia said:
it's the most recent anandtech article, let me try to find it

www.anandtech.com

Best CPUs for Gaming: February 2024

www.anandtech.com www.anandtech.com
Click to expand...

Looks to me like that chart is pure performance, not IPC.

Edit: Nevermind, after looking closer, it seems to be IPC even though it's not titled/mentioned as such. Without knowing exactly how they calculated the chart, it's hard to comment. Your Skylake over Excavator math is a little off though, it is 41% advantage to Skylake, not 27%. There are also a few tests in Spec that are heavily memory bound so using DDR5 Alderlake or increasing CPU cache between generations may have an exaggerated effect in those tests leading to a little bit of a skew in the overall IPC calculation.
 
Last edited:
Upvote 0 Downvote
N

nicalandia

Diamond Member
Jan 10, 2019
3,330
5,281
136
Hitman928 said:
Looks to me like that chart is pure performance, not IPC.

Edit: Nevermind, after looking closer, it seems to be IPC even though it's not titled/mentioned as such. Without knowing exactly how they calculated the chart, it's hard to comment. Your Skylake over Excavator math is a little off though, it is 41% advantage to Skylake, not 27%.
Click to expand...
Really?

am I looking at something different? Excavator shows 66%, Skylake 94%, Gracemont 93%, am I doing the math wrong?

1637699875094.png
 
Upvote -1 Downvote
DrMrLordX

DrMrLordX

Lifer
Apr 27, 2000
21,620
10,829
136
@nicalandia

You should try comparing the SPEC 526.blender_r sub-results between two processors to the actual performance delta in release Blender builds between the same two processors, if you want to talk about SPEC. Humour me, it should be interesting.

(you aren't the only one to notice the discrepancies between SPEC performance deltas and other benchmarks, btw)
 
Upvote 0 Downvote
E

eek2121

Platinum Member
Aug 2, 2005
2,930
4,026
136
nicalandia said:
According to anandtech.com the SPEC suit is the "Go To" bench for IPC testing, but as you can see they have OG Zen beat Skylake IPC, which at the time OG Zen was on par with Broadwell-E and just behind Skylake, They also show Excavator only 44% behind Zen which is about 52% ahead of Excavator in reality.

Here is the SPEC06/17 Chart.

View attachment 53277





Here is the CB R15 just for reference.
www.guru3d.com

Core i9 12900K processor review (Page 7)

Meet Intel's new flagship CPU, the Core i9 12900K. It is based on the Alder Lake architecture and is reviewed here. This time around, Intel was back at the drawing board, creating a completely new ar...
www.guru3d.com www.guru3d.com
View attachment 53278


Another Chart
View attachment 53279

Also there were no IPC improvement from Skylake to Comet Lake.
Click to expand...

Full disclaimer, I did not read all the comments in the post because I have been unwell, but I came here to say that there is not a single benchmark out there that can cover all performance scenarios. That includes SPEC and Cinebench.

As a general rule of thumb, a CPU that is a leader in both these benchmarks will likely be a performance leader, but that is absolutely NOT always the case.
 
Upvote 0 Downvote
tamz_msc

tamz_msc

Diamond Member
Jan 5, 2017
3,772
3,591
136
Hitman928 said:
Looks to me like that chart is pure performance, not IPC.

Edit: Nevermind, after looking closer, it seems to be IPC even though it's not titled/mentioned as such. Without knowing exactly how they calculated the chart, it's hard to comment. Your Skylake over Excavator math is a little off though, it is 41% advantage to Skylake, not 27%. There are also a few tests in Spec that are heavily memory bound so using DDR5 Alderlake or increasing CPU cache between generations may have an exaggerated effect in those tests leading to a little bit of a skew in the overall IPC calculation.
Click to expand...
It's IPC for the AMD parts at least, and core performance for the Intel parts. The math checks out.

Excavator -> Zen: 66 -> 100: 51.5% uplift (AMD claim 52%)
Zen+ -> Zen 2: 103 -> 118: 14.5% uplift (AMD claim 15%)
Zen 2 -> Zen 3: 118 -> 141: 19.4% uplift (AMD claim 19%)
 
  • Like
Reactions: lightmanek
Upvote 0 Downvote
A

Abwx

Lifer
Apr 2, 2011
10,939
3,440
136
DrMrLordX said:
@nicalandia

You should try comparing the SPEC 526.blender_r sub-results between two processors to the actual performance delta in release Blender builds between the same two processors, if you want to talk about SPEC. Humour me, it should be interesting.

(you aren't the only one to notice the discrepancies between SPEC performance deltas and other benchmarks, btw)
Click to expand...

Besides Spec, wich has a FP and INT benches, IPC can be grossly characterised with Cinebench for FP and something like 7 ZIP for INT, the latter is somewhat sensitive to RAM latency and speed contrary to the former.
 
Upvote 0 Downvote
T

Thala

Golden Member
Nov 12, 2014
1,355
653
136
Abwx said:
Besides Spec, wich has a FP and INT benches, IPC can be grossly characterised with Cinebench for FP and something like 7 ZIP for INT, the latter is somewhat sensitive to RAM latency and speed contrary to the former.
Click to expand...

I disagree with Cinebench, it contains too much hand written processor specific code in order to be used as reference.
 
  • Like
Reactions: deasd and scineram
Upvote 0 Downvote
J

JoeRambo

Golden Member
Jun 13, 2013
1,814
2,105
136
It also depends on CB version, for example CB15 was characterized in this classic piece here:

chipsandcheese.com

Analyzing Zen 2’s Cinebench R15 Lead

Cinebench R15 (CBR15) is a popular benchmark based on Cinema4D’s 3D rendering engine. It can utilize all available CPU threads, but here we’ll be analyzing it in single thread mode. In …
chipsandcheese.com chipsandcheese.com

Basically a mix of SSE scalar and memory instructions. Does not make much use of vector units. Fits Zen architecture like a glove.

Overall what i hate about rendering benchmarks - is that they are irrelevant for 99.9% of people. At least with something like x264 or x265 encodes there are more people who do the encodes of their home collections etc, while with rendering - you are either in that sphere or not. And frankly with workload characteristics like that it is easy to see why rendering is moving to GPUs big time.
 
  • Like
Reactions: tamz_msc
Upvote 0 Downvote
Gideon

Gideon

Golden Member
Nov 27, 2007
1,625
3,649
136
JoeRambo said:
Overall what i hate about rendering benchmarks - is that they are irrelevant for 99.9% of people. At least with something like x264 or x265 encodes there are more people who do the encodes of their home collections etc, while with rendering - you are either in that sphere or not. And frankly with workload characteristics like that it is easy to see why rendering is moving to GPUs big time.
Click to expand...

Yeah. Blender Cycles X is now available for RDNA1/2 GPUs (and soon on M1X with v 3.1) for free. Raytracing support (OptiX alternative) will probably be added in the near-future as well. It's often an order of magnitude faster on GPUs. It makes less and less sense to use it as the be-all-end-all multicore CPU benchmark.
 
  • Like
Reactions: Makaveli and tamz_msc
Upvote 0 Downvote
You must log in or register to reply here.

TRENDING THREADS

COMPANY
RESOURCES
FOLLOW
Top Bottom