Apple Silicon LLM Inference Benchmark Suite
Rigorous performance analysis of open-source LLMs on Apple Silicon — comparing quantization strategies, memory throughput, and tokens/sec across Llama 3.2, Mistral 7B, Phi-3, and Qwen2.5. A clean CLI anyone can run, built on MLX and llama.cpp.
- MLX
- llama.cpp
- Metal
- Quantization
↳ fp16 · q8 · q4 · q2 — reproducible latency, memory & quality deltas