discussion AMD looking at discrete NPU

[moocow]

Basically, AMD is poking their OEM customers to see if there is a market for a discrete NPU that handles AI inference without the power consumption of a GPU. Dell is offering one of their laptop with a Qualcomm AI 100 PC Inference Card instead of a GPU. It's strictly to run LLM on device so if you want to render video, not the right device for that sort of work.

AMD Is Reportedly Looking to Introduce a Dedicated Discrete NPU, Similar to Gaming GPUs But Targeted Towards AI Performance On PCs; Taking Edge AI to New Levels

AMD is considering developing a discrete NPU solution for PC consumers, allowing the average system to gain supercharged AI capabilities.

wccftech.com

 

[Izerous]

I'd make use of 2 if they were more power efficient than a GPU