Latest developments

Illustration of glowing blocks flowing between RAM sticks and a graphics card inside a PC

llama.cpp v0.8.0 adds LFM3, DeepSeek V4.1 Flash and a cache for MoE experts kept in system RAM

The llama.cpp v0.8.0 release adds Liquid AI's LFM3 text, vision, audio and omni models, DeepSeek V4.1 Flash, Flint and several other architectures. It also adds a cache for mixture-of-experts layers held in system memory, new realtime-audio and text-to-speech server endpoints, and CUDA, SYCL and OpenCL performance work.

Why it matters

Many PC owners run large mixture-of-experts models by keeping some experts in system RAM when they don't fit in VRAM, and this release targets exactly that setup. It also means LFM3 now runs on Windows and Linux through llama.cpp directly, ahead of Ollama's PC builds.

Source: llama.cpp Releases (GitHub) github.com
  • software
  • gpu
  • memory

More news

All news