Latest developments

Ollama and llama.cpp add Recursive Flint, with Ollama running it on Macs first

Ollama 0.40.8 added Recursive Flint, the open 40B mixture-of-experts coding model released this week, and says it currently runs on macOS only, with other GPUs to follow in a later release. llama.cpp added Flint support in build b11803 the same day, with prebuilt CUDA, ROCm, Vulkan and Metal builds.

Why it matters

Mac owners with enough unified memory can try Flint today with one Ollama command. On Windows and Linux GPUs, llama.cpp is the way to run it until Ollama's broader GPU support lands.

Source: Ollama on GitHub github.com
  • software
  • mac
  • ollama
  • llama-cpp

More news

All news