Running Local LLMs on an AMD APU Laptop with 56GB Unified Memory
Running Local LLMs on an AMD APU Laptop with 56GB Unified Memory I recently got a Lenovo ThinkPad P14s Gen 6 with the AMD Ryzen AI 9 HX PRO 370 and 56GB of LPDDR5x RAM. I wanted to see what I could actually run on it for local LLM inference, and it turns out the answer is “quite a lot” if you know how to get around a couple of gotchas with the AMD iGPU memory model. ...