40-45 watts idle ? 120w-130w for CPU? Stock ARM cores are such a mess.First power measurements I have seen and also some interesting bits https://www.servethehome.com/nvidia-dgx-spark-review-the-gb10-machine-is-so-freaking-cool/
40-45 watts idle ? 120w-130w for CPU? Stock ARM cores are such a mess.First power measurements I have seen and also some interesting bits https://www.servethehome.com/nvidia-dgx-spark-review-the-gb10-machine-is-so-freaking-cool/
I was so looking forward to Strix Halo, but these things are insanely expensive 😭Cheapest M4 MAX Mac Studio WITH 128GB RAM is $3499
Cheapest M3 Ultra Mac Studio with AT LEAST 128 GB RAM (256GB model, only other is 96GB) is $5599
Available Ryzen AI Max+ 395 SFF PCs with 128GB RAM
GMKTek
AMD Ryzen™ AI Max+ 395 --EVO-X2 AI Mini PC $1999
Nimo's Smallest Office & Gaming AI PC - AMD Ryzen™ AI Max+ 395 (up to 5.1 GHz) - 128GB LPDDR5 8000MHz (16GB*8) - 2TB/4TB SSD With 3 Performance Modes Up to 120W $1869
Bosgame M5 AI Mini Desktop Ryzen AI Max+ 395 96GB/128GB+2TB $1699
Framework's 128GB configs start at $2099 with a 1TB drive.
That 256 bit bandwidth comes with a cost, to the point that we can purchase 2 MAX 395 devices for the same price (or just a bit more) and also keep the same software ecosystem we are already using. Their newer, faster devices are certainly NOT going to be any cheaper.
They are both stabbing at different sections of the market, which is admittedly quite niche at this point.
stuff will get cheaper once units increment up.I was so looking forward to Strix Halo, but these things are insanely expensive 😭
That would be preferable certainly.It'll be even cheaper for mdsH due to adjacent market die sharing.
quite literally the strategy.That would be preferable certainly.
Insanely expensive as compared to... what exactly? How cheaply do you think that you can get a pro level video card that has at least 96GB of VRAM? The NVidia RTX Pro 6000 Blackwell is north of $8000. There's a Huawei card that's a bit of an unknown quantity, but it's still almost $2000... And that's before you build the rest of the system...I was so looking forward to Strix Halo, but these things are insanely expensive 😭
That is why I quoted it, to confirm the warnings in case anyone had doubtsWe were warned about the display unit . . .
But they lack compute. Neither is actually supposed to replace H100For LLMs, bandwidth is as important as compute and the Mac Studios have 512 bits up to 128 GB RAM capacity and 1024 bits up to 512 GB of RAM.
512b bandwidth?That 256 bit bandwidth comes with a cost, to the point that we can purchase 2 MAX 395
At least Halo doesn't idle at 40WThe performance and power of the CPU part seems comparable to Strix Halo.
But they lack compute. Neither is actually supposed to replace H100![]()
I guess their d2d shoreline for the GPU is puny? idk.View attachment 132034It’s dead cause this.
AMD SH does like 32 tok/sec, much cheaper. This spark is strictly for people with more money than sense.
Lol. The M5 Pro/Max with its new GPU architecture will crush it. I wouldn't be surprised if the M5 Pro comes with a max configuration of 128 GB RAM, and the M5 Max gets 256 GB RAM.View attachment 132034It’s dead cause this.
AMD SH does like 32 tok/sec, much cheaper. This spark is strictly for people with more money than sense.
I don't be even surprised if they revives the Ultra tier... with 512 GB RAM...Lol. The M5 Pro/Max with its new GPU architecture will crush it. I wouldn't be surprised if the M5 Pro comes with a max configuration of 128 GB RAM, and the M5 Max gets 256 GB RAM.
M3 Ultra already supports 512GB. If there is an M5 Ultra, it will likely be higher since has been steadily increasing the max RAM (e.g. M2 Ultra was 192GB). I’m thinking 1TB in the next round, as long as they can source the appropriate memory chips. M5 max might go to 256.I don't be even surprised if they revives the Ultra tier... with 512 GB RAM...
1TB RAM... that's really insane.M3 Ultra already supports 512GB. If there is an M5 Ultra, it will likely be higher since has been steadily increasing the max RAM (e.g. M2 Ultra was 192GB). I’m thinking 1TB in the next round, as long as they can source the appropriate memory chips. M5 max might go to 256.
