Running Gemma 4 26B at 5 tokens/sec on a 13-year-old Xeon with no GPU
Running Gemma 4 26B at 5 tokens/sec on a 13-year-old Xeon with no GPU
www.neomindlabs.com
Running Gemma 4 26B at 5 tokens/sec on a 13-year-old Xeon with no GPU | Neomind
A storage appliance that shipped before AVX2 existed now runs Google's Gemma 4 26B in my basement, no GPU. Here's how we got a modern MoE model onto a CPU older than the instructions its inference eng...