#metal

Why local LLM inference stalls on Apple Silicon (and how to fix it)

Local LLM inference on Apple Silicon often runs at a fraction of what the hardware can do. Here's why — and how to fix it with kernel fusion, KV cache layout, and the right quantization.