IBM's Granite Speech 5.0 brings a 2B transcription model that runs in llama.cpp and on Apple Silicon
IBM released granite-speech-5.0-2b, an open Apache 2.0 speech model for transcription and translation in six languages, plus faster updates to its smaller Turbo CTC and multi-speaker models. The 2B model works with llama.cpp, vLLM and mlx-audio, and IBM publishes an official GGUF build.
Why it matters
Accurate meeting and voice transcription no longer needs a cloud service or a big GPU. A 2B model is small enough for most recent laptops, Macs and entry-level graphics cards.