https://notes.alelec.net/tags/gemma/ Recent content in Gemma on alelec blog Hugo en-us Mon, 13 Apr 2026 10:00:00 +1000 https://notes.alelec.net/posts/running-local-llms-on-amd-apu-laptop/ Mon, 13 Apr 2026 10:00:00 +1000 https://notes.alelec.net/posts/running-local-llms-on-amd-apu-laptop/ <p>I recently got a Lenovo ThinkPad P14s Gen 6 with the AMD Ryzen AI 9 HX PRO 370 and 56GB of LPDDR5x RAM. I wanted to see what I could actually run on it for local LLM inference, and it turns out you can run pretty large models if you know how to get around a couple of gotchas with the AMD iGPU memory model.</p> <p>The short version: I&rsquo;m running Qwen3.5-35B-A3B (a 35 billion parameter MoE model) and Gemma-4-26B-A4B (26B, also MoE) locally, served as an OpenAI-compatible API accessible from other machines on my network. No discrete GPU required. I&rsquo;ve since put them to work on a real batch classification task (triaging ~4000 GitHub issues for the MicroPython project) and compared their output quality against Claude Sonnet.</p>