https://drlongnecker.com/tags/mixture-of-experts/Recent content in Mixture-of-Experts on David R. Longnecker - Converting Coffee to CodeHugoen-USFri, 04 Sep 2026 09:00:00 -0600https://drlongnecker.com/blog/2026/09/gpu-didnt-get-faster-local-llm-efficiency/Fri, 04 Sep 2026 09:00:00 -0600https://drlongnecker.com/blog/2026/09/gpu-didnt-get-faster-local-llm-efficiency/<p>As I discussed in my <a href="https://drlongnecker.com/blog/2026/09/ai-chips-dont-fix-gaming-gpu-prices">last post</a>, the price of consumer GPUs likely isn&rsquo;t changing anytime soon. Following various threads, most are either accepting the price point or looking at dedicated hardware like DGX Spark which is around the same $5,000 price point (and many joke of &ldquo;get 2 or 3!&rdquo;).</p> <p>My homelab rack is still rocking the GTX 1080 <a href="https://drlongnecker.com/blog/2026/03/proxmox-lxc-nvidia-gpu-passthrough-ollama/">I found in a storage closet and got running inside an LXC container</a> a while back. I hadn&rsquo;t planned to dig into it anymore (it&rsquo;s setup and working), but then I went looking for a bigger local model and found that while not much had changed on my end, a lot had changed inside the models.</p>