Discussion Intel current and future Lakes & Rapids thread

Page 718 - Seeking answers? Join the AnandTech community: where nearly half-a-million members share solutions and discuss the latest tech.

Exist50

Platinum Member
Aug 18, 2016
2,452
3,106
136
You are saying they'll be used in very small amounts but I'm saying there's a very good chance it'll exist which do not contradict each other.
I'm not sure it'll exist at all. Keep in mind this is a leak, not from Intel. What sense would there be in a leaker sandbagging on Intel's behalf?
Which is a good trend, since it means they aren't overpromising anymore. I think the new mentality is also representative of better management because you need the conservative expectations so they can better meet their goals.
Well, the much bigger question is whether they're being conservative with their timelines. No one cares about a narrowly binned SKU on the top of the stack if it's a year+ late.
 

Exist50

Platinum Member
Aug 18, 2016
2,452
3,106
136
The 60 Core SKU does exist. The name is Xeon Platinum 8490H we have plenty info leaked on that CPU
Sure, it exists, but in what volume? If they're only shipping O(10,000), then it might as well not exist as far as some of the major customers (e.g. cloud) are concerned. And they only have one SKU with 60c compared to several with 56, so I think 56 is where most of the high end volume will be.
Witaken with more info on Sierra Forest.
Taking the claims at face value for now, that seems like a weird decision. It would still be useful to have lower end SRF options, but to eschew making a proper 400-600 core throughput monster? Just feels like wasted potential. Maybe DRAM bandwidth issues with feeding that many cores?
 

LightningZ71

Platinum Member
Mar 10, 2017
2,508
3,191
136
I wonder if Intel is just banking on the fact that the are still trying to support quad and eight processor configurations for their processors with respect to having lower total core counts than AMD. I realize that those are vanishingly small markets, but they do exist...
 

nicalandia

Diamond Member
Jan 10, 2019
3,331
5,282
136
I wonder if Intel is just banking on the fact that the are still trying to support quad and eight processor configurations for their processors with respect to having lower total core counts than AMD. I realize that those are vanishingly small markets, but they do exist...
Sapphire Rapids-SP will support 8S system with the maximum total core count will be 480 Cores vs 192 Cores for Genoa
 

Exist50

Platinum Member
Aug 18, 2016
2,452
3,106
136
I wonder if Intel is just banking on the fact that the are still trying to support quad and eight processor configurations for their processors with respect to having lower total core counts than AMD. I realize that those are vanishingly small markets, but they do exist...
I don't think they're really "banking" on anything at this point. If there's a market AMD's underserving, they might be happy for the win, but that's not exactly a strategy.
 

Markfw

Moderator Emeritus, Elite Member
May 16, 2002
27,241
16,107
136
Sapphire Rapids-SP will support 8S system with the maximum total core count will be 480 Cores vs 192 Cores for Genoa
What will that 480 core system draw ? like over 4000 watts ? I don't see that happening.
 

nicalandia

Diamond Member
Jan 10, 2019
3,331
5,282
136
What will that 480 core system draw ? like over 4000 watts ? I don't see that happening.
Close to 3,000 Watts...

But CoolIT has them covered with this 500KW Water Cooling Unit.
1669149649254.png
 

Markfw

Moderator Emeritus, Elite Member
May 16, 2002
27,241
16,107
136
Genoa 480 cores would be 360*2.5 or about 900 watts. Why would a data center choose to spend 3 x the power, and 3x the AC and 3x the APC power for the same or less performance ?

Edit: and for those who will pick at my numbers, lets just say a LOT more power for that 480 core Intel system. And does that system have SMP ?
 
Last edited:

nicalandia

Diamond Member
Jan 10, 2019
3,331
5,282
136
Does that system have SMP ?
According to YuuKiAnS(which has 4S and 8S on the lab he works at) Intel is implementing the 8S system as two 4S System stitched/glued together. Intel has many times reported that their CPU will Support Multi-Socket Scaling with their Intel Utra Path Interconect UPI 2.0. 8S-4UPI Performance Optimized Topology.
 

Markfw

Moderator Emeritus, Elite Member
May 16, 2002
27,241
16,107
136
According to YuuKiAnS(which has 4S and 8S on the lab he works at) Intel is implementing the 8S system as two 4S System stitched/glued together. Intel has many times reported that their CPU will Support Multi-Socket Scaling with their Intel Utra Path Interconect UPI 2.0. 8S-4UPI Performance Optimized Topology.
What I was asking was, are those e-cores ? or p-cores with smp ? With that many, maybe its just e-cores ?
 

Exist50

Platinum Member
Aug 18, 2016
2,452
3,106
136
8S SPR would presumably be implemented in two blades, but with their standard UPI topology.

1669152979470.png

Edit: and for those who will pick at my numbers, lets just say a LOT more power for that 480 core Intel system. And does that system have SMP ?
Availability and price. Though 8S in particular would have the advantage of a larger coherency domain, niche market though that is.
 

nicalandia

Diamond Member
Jan 10, 2019
3,331
5,282
136
As impressive as 240 Cores(4S) and 480 Cores(8S) are, many apps even the most Multi-Threaded found on Unix/Linux Systems. Just don't scale well the moment they hop to a different Socket..


1669153848791.png
 
Last edited:

Geddagod

Golden Member
Dec 28, 2021
1,524
1,620
106
Genoa 480 cores would be 360*2.5 or about 900 watts. Why would a data center choose to spend 3 x the power, and 3x the AC and 3x the APC power for the same or less performance ?

Edit: and for those who will pick at my numbers, lets just say a LOT more power for that 480 core Intel system. And does that system have SMP ?
I thought Genoa was limited to max 192 cores since it was 2P?
 

itsmydamnation

Diamond Member
Feb 6, 2011
3,072
3,897
136
4S and 8S systems are generally space inefficient.

if you need cores and not much memory / storage , then 2U sleds.
if you need cores + memory 1U 2P
if you need cores + memory + local attached disk / lots of PCI-E 2P , 2U

4 socket servers , 1 or 2 RU end up only giving you cores and when your sockets only have 1/2 the cores all you are doing is creating a system for niche use cases.
 

MadRat

Lifer
Oct 14, 1999
11,999
307
126
Imagine how much testing is necessary to assure bulletproof products in 8S space compared to 2S. One bad board could soil your reputation with a customer.
 

IntelUser2000

Elite Member
Oct 14, 2003
8,686
3,787
136
Taking the claims at face value for now, that seems like a weird decision. It would still be useful to have lower end SRF options, but to eschew making a proper 400-600 core throughput monster? Just feels like wasted potential. Maybe DRAM bandwidth issues with feeding that many cores?

Probably because they don't need it?

Let me lay out few things on the table before continuing the discussion.
-AMD/Nvidia has been accused of price fixing for their GPUs.
-Microprocessor engineering is a very, very high level skill, so people who can do so are limited.
-When you hear a high profile engineer/executive leave, they end up in competitor companies. Literally you are sucking a resource from one and move it to the other.
-They are people after all, and it puts a lot of demand on their time and energy.
-And at last, they are a business here to make money.

We cheer for the companies we like and would like them to "crush" the competition with some amazing product that the competitor will never be able to touch. And do so for years and years until the other party is dust.

Remember when Andy Grove wanted to use their resources and advantage to crush AMD, Moore stopped him.

The reality is that in the big picture, competition is there to just be little better than each other. And I am not saying that necessarily in a negative light either. For whatever reason, the fantastic claims never turn out. It makes sense too, since these guys are at the top of the game already. Pushing yourself to create something no-one has ever done before in the history of mankind is hard, to put it simply.

In the big picture, the better competitor is always within reach. How many people believed that Turin will go 200, or even 300+ cores? Now it looks like they'll barely go above 128, if that. Coincidentally so Granite Rapids has a chance.

Other thing is that the better core is dwarfed by better process. The Atom team being way better is probably still not better-enough to get an actual 3-4x advantage. I assume it's enough to make a difference, like putting it strategically in hybrid configs to make Raptorlake competitive, or Sierra Forest competitive with ARM competitors, and in cloud save 30% power or $ per chip vs having Granite Rapids of equal core count.

You either run into scaling challenges(core/IO/software), or the real goal is to get it higher perf/watt and/or higher perf/$. 30% gain is NOT a trivial gain at all! It's absolutely huge!

That's why I don't believe Falcon Shores will be revolutionary as some think. Reserve judgment until it happens. Advancement is always successive. So-called "revolutionary technologies" just act as something to break barriers, and nothing more.
 
Last edited:

IntelUser2000

Elite Member
Oct 14, 2003
8,686
3,787
136
@ashFTW Great to see that you resort to personal attacks.

Look at how much the implementation of hybrid is a fine balancing act, and it's the details that make all the difference. Ring bus frequency, voltage domains. Jasper Lake is far more efficient than Gracemont primarily because Gracemont is on the same die as P cores and uses the same resources.

It has nothing to do with future vision. Purpose oriented optimization is what gives you the final advantage to stand out. And that can be any metric, whether it be cost, performance, or power. You can never have a truly unified platform across all stacks for this very reason. Servers can be small as $200 Atom C3000 board for open source routers to $500 million HPC setups. Are you really that naive to believe those chasms can be socket unified?

If anything, platform variation continues to proliferate, not the other way around.
 

ashFTW

Senior member
Sep 21, 2020
325
247
126
@ashFTW Great to see that you resort to personal attacks.
I sincerely apologize; I have regarded you highly here in the past. It will not happen again. I felt bad the day after posting it, and I didn’t see you here for a while, which made me feel worse.

Look at how much the implementation of hybrid is a fine balancing act, and it's the details that make all the difference. Ring bus frequency, voltage domains. Jasper Lake is far more efficient than Gracemont primarily because Gracemont is on the same die as P cores and uses the same resources.

It has nothing to do with future vision. Purpose oriented optimization is what gives you the final advantage to stand out. And that can be any metric, whether it be cost, performance, or power. You can never have a truly unified platform across all stacks for this very reason. Servers can be small as $200 Atom C3000 board for open source routers to $500 million HPC setups. Are you really that naive to believe those chasms can be socket unified?

If anything, platform variation continues to proliferate, not the other way around.
Look at what AMD has been able to achieve with just a few chips. It’s important to do designs that can be reused across a wide range of products. That’s the whole idea behind chiplets. Intel is perpetually late to market; parsimonious designs is crucial to overcoming this constant hurdle. And I was only talking about high end computing solution -- what’s covered today by SPR, PVC etc. Falcon Shores seems like the right approach to me. It can be the common platform for integration of several key future technologies Including optical interconnects, extreme bandwidth memory/caching etc
 

DrMrLordX

Lifer
Apr 27, 2000
22,902
12,971
136
Coincidentally so Granite Rapids has a chance.

Maybe. It has been moved to another process already; in fact ,what Granite Rapids is (or is meant to be) now is vastly different from what it was before. Intel has a lot riding on that product. That was maybe not what you had intended to discuss as your primary subject (Falcon Shores), but the point had to be made.

So uh, regarding Intel “On Demand”, you that saying that is something line “Nobody ever get’s fired for buying Intel.”?

If I hire you, and you buy one of these products. you are fired. Just an FYI. 😉

Once upon a time, nobody got fired for buying IBM. Then Intel (starting with the Pentium Pro) started eating away at their business, along with the business of a number of other Big Iron purveyors. And IBM had (and still has) the "golden wrench". SDSi is really just copying from IBM's playbook.
 

Exist50

Platinum Member
Aug 18, 2016
2,452
3,106
136
Probably because they don't need it?

Let me lay out few things on the table before continuing the discussion.
-AMD/Nvidia has been accused of price fixing for their GPUs.
-Microprocessor engineering is a very, very high level skill, so people who can do so are limited.
-When you hear a high profile engineer/executive leave, they end up in competitor companies. Literally you are sucking a resource from one and move it to the other.
-They are people after all, and it puts a lot of demand on their time and energy.
-And at last, they are a business here to make money.

We cheer for the companies we like and would like them to "crush" the competition with some amazing product that the competitor will never be able to touch. And do so for years and years until the other party is dust.

Remember when Andy Grove wanted to use their resources and advantage to crush AMD, Moore stopped him.

The reality is that in the big picture, competition is there to just be little better than each other. And I am not saying that necessarily in a negative light either. For whatever reason, the fantastic claims never turn out. It makes sense too, since these guys are at the top of the game already. Pushing yourself to create something no-one has ever done before in the history of mankind is hard, to put it simply.

In the big picture, the better competitor is always within reach. How many people believed that Turin will go 200, or even 300+ cores? Now it looks like they'll barely go above 128, if that. Coincidentally so Granite Rapids has a chance.

Other thing is that the better core is dwarfed by better process. The Atom team being way better is probably still not better-enough to get an actual 3-4x advantage. I assume it's enough to make a difference, like putting it strategically in hybrid configs to make Raptorlake competitive, or Sierra Forest competitive with ARM competitors, and in cloud save 30% power or $ per chip vs having Granite Rapids of equal core count.

You either run into scaling challenges(core/IO/software), or the real goal is to get it higher perf/watt and/or higher perf/$. 30% gain is NOT a trivial gain at all! It's absolutely huge!

That's why I don't believe Falcon Shores will be revolutionary as some think. Reserve judgment until it happens. Advancement is always successive. So-called "revolutionary technologies" just act as something to break barriers, and nothing more.
I'm really not sure how all this applies to Sierra Forest. If the argument is that so many cores would be so strong relative to the competition, Intel would instead prefer to sandbag, then I heartily disagree. Intel is clearly in no position to be holding back, and who knows where the ARM vendors or Bergamo's successor will be in 2024. Moreover, for the in-house ARM vendors in particular, Intel doesn't just have to build the better product to win over Amazon, Microsoft, etc., but to be better TCO against something with effectively zero margin requirement. That's tough to say the least. AMD is facing much the same threat, so I doubt they're sandbagging either.

Also, occasionally there are large leaps that require years for the competition to close the gap. Conroe, Maxwell, Zen in a sense. Granted, these are usually in response to some acute need or competitive threat, but still.
Remember when Andy Grove wanted to use their resources and advantage to crush AMD, Moore stopped him.
What ever happened to "Only the paranoid survive"?
That's why I don't believe Falcon Shores will be revolutionary as some think. Reserve judgment until it happens. Advancement is always successive. So-called "revolutionary technologies" just act as something to break barriers, and nothing more.
I don't believe in Falcon Shores just because I have zero faith in Raja's org successfully building something of such a massive scope. Maybe if it was a combined effort with the Xeon team, but that doesn't seem to be what they're aiming for. But if by some miracle they do succeed, could be quite interesting. But by then AMD and Nvidia will probably be on gen 2 at minimum.
 
  • Like
Reactions: Tlh97

IntelUser2000

Elite Member
Oct 14, 2003
8,686
3,787
136
I'm really not sure how all this applies to Sierra Forest. If the argument is that so many cores would be so strong relative to the competition, Intel would instead prefer to sandbag, then I heartily disagree.

I am not saying they are going to sandbag, just that whatever they have might be enough. AMD isn't using the more area efficient Zen 4c to build many, many more cores than Genoa either. It's "just" 33% more, which when you are talking about being in a ballpark top of the field, it's enough to make a difference.

We don't know enough about Bergamo to know why you'd get it over Genoa. The leaks show similar 300-400W TDP level and it's being called "Density Optimized". Is it cheaper then? Somehow I have a feeling a 350W chip isn't going to be <$1000 cheap. So the benefits of Bergamo compared to Genoa is narrower than we initially expected. It's not a low TDP chip, and it's core count isn't immensely greater.

Maybe Sierra Forest is different and more "density optimized" that way but usually the end result is surprisingly similar. Maybe Sierra Forest will go to 144 cores but Bergamo or whatever it'll compete with will be faster per core, making SRF more of a purpose oriented cloud chip while Bergamo is more in between.

Early leaks for Sierra Forest had a 7000-pin -AP version using what's called "SSHPmont". I assume that means "Super Speed High Performance-mont". Because it's AP it's very plausible it was a version with AVX-512 support, maybe with 1x-512 units like client units or 2 cycle like with AMD which is double Gracemont.

Maybe they have changed this. If you read twitter Retiredengineer replied to witeken saying "you'll be disappointed" when witeken was expecting 448 Crestmont-based cores. And Retiredengineer referred back to that quote, so he knew that way back.

I know with Smartphones some were predicting we'll have 32+ cores very soon, and clearly it stopped as well. Arrowlake was rumored to be 8+32 and with future chips some were thinking 8+40 or even greater, but real Arrowlake is 8+16.

I am saying taming expectations is reasonable because the balance is a bell curve. It's with everything. Power is very simply put P=CV2F, but you aren't seeing 0.6V GPUs in operation. Because below 0.9V the frequency drops non-linearly, which is a nice way of saying it plummets. So rather than 0.6V being 2/3rds the frequency of 0.9V, you get something like 1/3rds the frequency and sure it uses very little power but it's not a useful workload frequency.

And if you lower chip power too much, then the IO and memory is more or less fixed and they start dominating so it's again a bad balance. So in reality the engineers drop it by 100mV, do workload optimizations, cut leakage, and dozen other things.

Even if you could lower whole chip power by simply lowering voltage, you'd have to significantly increase die space. If engineering such things were easy then they could just hire college graduates and be done. But it's not at all. In fact it's one of the most complex things humans can do!

So while the E cores are actually power efficient when you put it in the proper habitat, it also follows a bell curve and in case of desktop chips it's entirely about area density. So if Gracemont goes back into being a N-series chip, it'll again be very, very power efficient, because it's a perfect match for the IO and the frequency balance is good, etc. And I bet the P core chips seem efficient in power for the desktop chips but they might have high leakage and/or worse scaling at lower frequencies so it's a terrible chip for N series platform.

@ashFTW I appreciate that. Just saying I am on the conservative side when it comes to expectations. But that in itself is a contradiction, because computing is absolutely cutting edge. You still have a balance though.

Look at technologies today that are seen as clear advancements over predecessors. LEDs and Solid State Drives for example. Were they that good initially? LEDs were mere indicator lights for dashboards! Solid State drives were either very expensive or the performance(with 2-bit "MLC) completely sucked. Again, it took over a decade! But of course without them the advancement would slow to a near halt. So revolutions break the wall. They aren't super duper good out of the gate.
 
Last edited:
  • Like
Reactions: lightmanek

Exist50

Platinum Member
Aug 18, 2016
2,452
3,106
136
Because it's AP it's very plausible it was a version with AVX-512 support, maybe with 1x-512 units like client units or 2 cycle like with AMD which is double Gracemont.
I sincerely doubt they're adding AVX-512 to Atom, and they're certainly not going to do so for just one product line.

If Sierra Forest maxes out just a bit above GNR, let's say 144 cores for nice math, then that yields an area equivalent to ~36 RWC. That would almost certainly be part of the SP line, not AP, and thus max out well below the IO and power capabilities of an AP product. Really, the only reason I could see for such a decision is to limit development resources.
So while the E cores are actually power efficient when you put it in the proper habitat, it also follows a bell curve and in case of desktop chips it's entirely about area density.
Same applies to server. Density is very valuable from a TCO and product cost perspective.

Oh, and while I'm on the topic, I fully expect Royal to be added to the "revolutionary technologies" list. Ah, wish they would hurry up with it.