News Intel 4Q25 Earnings

[mikegg]

Big dawg those have DRAM requirements in 10s of gigabytes.
Get real.

Kimi K2 is 1 trillion params.

Get real. Stop living under a rock. This guy still thinks local LLMs are 7b. 😅

https://twitter.com/x/status/2001817749744476256

 

[poke01]

Kimi K2 is 1 trillion params.

Get real. Stop living under a rock.

https://twitter.com/x/status/2001817749744476256

cool but you know that this is out of topic.

 

[adroc_thurston]

Kimi K2 is 1 trillion params.

Get real. Stop living under a rock. This guy still thinks local LLMs are 7b. 😅

this wank is in no way related to normal PCs with 16G of DRAM.

 

[mikegg]

this wank is in no way related to normal PCs with 16G of DRAM.

Hence, I said Intel is missing the boat on unified memory with high capacity and high bandwidth.

It was you who started by saying local llms = 7b models.

 

[mikegg]

cool but you know that this is out of topic.

No it isn't. Trace the replies back. You'll find that it is on topic.

 

[itsmydamnation]

Hence, I said Intel is missing the boat on unified memory with high capacity and high bandwidth.

It was you who started by saying local llms = 7b models.

really......

like do people choose to just be contrary because thewy have nothing else of value to add.

i am microslop , i can develop a local LLM to do X/Y/Z .

i am picking my hardware target for mass adoption. am i
1. going to pick a 7/14/etc B 8bit model
2 going to pick a 1T *bit model


sigh

 

[DrMrLordX]

https://twitter.com/x/status/2001817749744476256

How expensive is a setup like that? Could you realistically get a server board + CPU + 2TB RAM and reach the same performance levels in the same budget? Would be interesting to see a comparison (since this is an Intel earnings thread, let's say you try it with Granite Rapids).

 

[511]

How expensive is a setup like that? Could you realistically get a server board + CPU + 2TB RAM and reach the same performance levels in the same budget? Would be interesting to see a comparison (since this is an Intel earnings thread, let's say you try it with Granite Rapids).

Entirely depends on ram cost you can get a 128C GNR CPU for like $6K USD the RAM is the only pain point

 

[DrMrLordX]

Entirely depends on ram cost you can get a 128C GNR CPU for like $6K USD the RAM is the only pain point

Well you're paying for RAM whether you buy the Mac Minis or the server board.

 

[511]

Well you're paying for RAM whether you buy the Mac Minis or the server board.

well than 1 maxed out ultra is $14099 with 512GB RAM and 32 TB Storage

https://www.apple.com/shop/buy-mac/mac-studio/apple-m3-ultra-with-28-core-cpu-60-core-gpu-32-core-neural-engine-96gb-memory-1tb

Here is a GNR Server with similarish configuration
https://store.supermicro.com/us_en/configuration/view/?cid=1000429554&5554 fwiw RAM Price was more than half of server price

 

[mikegg]

really......

like do people choose to just be contrary because thewy have nothing else of value to add.

i am microslop , i can develop a local LLM to do X/Y/Z .

i am picking my hardware target for mass adoption. am i
1. going to pick a 7/14/etc B 8bit model
2 going to pick a 1T *bit model


sigh

There exists models in the range of 64GB - 100GB large that machines like Strix Halo and M4 Max are great for. 1T is an example of what's possible now locally using consumer/prosumer hardware.

 

[mikegg]

well than 1 maxed out ultra is $14099 with 512GB RAM and 32 TB Storage

https://www.apple.com/shop/buy-mac/mac-studio/apple-m3-ultra-with-28-core-cpu-60-core-gpu-32-core-neural-engine-96gb-memory-1tb

Here is a GNR Server with similarish configuration
https://store.supermicro.com/us_en/configuration/view/?cid=1000429554&5554 fwiw RAM Price was more than half of server price
View attachment 137323

Take out the 32TB SSD. That adds $5k to the final cost. Just use an external drive you need more storage. Much cheaper.

The most important thing here is the 512GB of unified memory.

So we're looking at $9.5k for a 512GB Mac Studio. You only need 1 Mac Studio to run Kimi K2 1T if you use the Q3 version.

 

[511]

Take out the 32TB SSD. That adds $5k to the final cost. Just use an external drive you need more storage. Much cheaper.

The most important thing here is the 512GB of unified memory.

So we're looking at $9.5k for a 512GB Mac Studio. You only need 1 Mac Studio to run Kimi K2 1T if you use the Q3 version.

Uhh the CPU can do that as well? also if you only want 512 GB Ram than the cost comes way down with storage

 

[mikegg]

Uhh the CPU can do that as well? also if you only want 512 GB Ram than the cost comes way down with storage

A CPU can’t have as much TFLOPs relative to die size.

Try running a large model like DeepSeek on Epyc or Xeon. It’s like watching paint dry.

 

[511]

A CPU can’t have as much TFLOPs relative to die size.

AMX is purpose built for AI it's literally Matmul for CPU

Try running a large model like DeepSeek on Epyc or Xeon. It’s like watching paint dry.

Like i said use a Xeon6 with AMX

Cost Effective Deployment of DeepSeek R1 with Intel® Xeon® 6 CPU on SGLang | LMSYS Org

<p>The impressive performance of DeepSeek R1 marked a rise of giant Mixture of Experts (MoE) models in Large Language Models (LLM). However, its massive mode...

lmsys.org

than we have this

 

[mikegg]

AMX is purpose built for AI it's literally Matmul for CPU

Like i said use a Xeon6 with AMX

Cost Effective Deployment of DeepSeek R1 with Intel® Xeon® 6 CPU on SGLang | LMSYS Org

<p>The impressive performance of DeepSeek R1 marked a rise of giant Mixture of Experts (MoE) models in Large Language Models (LLM). However, its massive mode...

lmsys.org

than we have this

A CPU will never have the combination of TFLOPs and memory bandwidth that can beat a GPU in inference efficiency.

It's ok if a CPU is all you have.

But for local LLMs, we already have something much faster and more cost effective than CPUs: Apple Silicon and Strix Halo.

 

[DrMrLordX]

well than 1 maxed out ultra is $14099 with 512GB RAM and 32 TB Storage

So the Mac solution in this case winds up costing $10k more. Not sure how the performance stacks up, but if what you really need is 2TB of RAM for your local LLM . . .