Discussion Beyond zen 6

[LightningZ71]

You're talking rationally. MS is talking money. They have modeled that a dedicated NPU will be more efficient for CoPilot always on. It's not a "high performance" situation.

 

[Fjodor2001]

MS is pushing a subscription sales model. They wanted an always on AI component in Windows that you were willing to pay for. If it drained your battery rapidly or worked like dog excrement, no one would buy it. The NPU helps with both.

Not sure what you mean by always on AI component. Always on as in always available, yes. Always on as in only for always on AI functionality, no, since it'll be used for more that always on AI functionality.

W.r.t. NPU vs (i)GPU to provide necessary TOPS, does it matter as long as the TOPS are provided? If the NPU can provide the necessary TOPS using better TOPS/W and lower cost, I guess NPU is better option than (i)GPU.

 

[soresu]

MS is pushing a subscription sales model. They wanted an always on AI component in Windows that you were willing to pay for. If it drained your battery rapidly or worked like dog excrement, no one would buy it. The NPU helps with both.

IMHO the vast majority aren't going to buy based on AI regardless of performance.

All these companies are desperately trying to push it to justify the hardware build out and running costs, but the returns are never going to match that spending.

 

[LightningZ71]

Oh, I don't dispute either of your points. The NPU was supposed to provide the most efficient implementation then possible for accomplishing the needed tasks without blowing the budget and nuking battery life. They were trying to FORCE the market instead of MEETING the market and the result if a very unwanted copilot in windows 11.