Latest developments

Illustration of a glowing llama made of circuit lines beside a row of sliders and a laptop with a chip

Ollama 0.40.14 stops overriding a model's own sampler settings on OpenAI-style APIs

Ollama's official release notes for 0.40.14 say its OpenAI-compatible endpoints no longer force a temperature and top_p of 1.0 when a client sends none, so the model's own packaged defaults apply, matching its native chat API. The release also adds faster top-k sampling on MLX for models with large vocabularies, which is the Apple silicon path.

Why it matters

If you point a coding tool or chat app at Ollama's OpenAI-style endpoint, replies may now behave the way the model's maker intended without any settings changes. Mac owners also get a small speed gain from the MLX sampling change, though this is a software fix and doesn't change what hardware you need.

Source: Ollama release notes github.com
  • software
  • mac

More news

All news