NVIDIA's Nemotron 3.5 Bolt packs a 74B agent model into 24GB for local PCs
NVIDIA released new open Nemotron 3.5 models, including Bolt 74B-A9B, a mixture-of-experts model with 9 billion active parameters that NVIDIA squeezed into 24GB with 2-bit quantization. NVIDIA built it for local agents on RTX Spark machines and says it runs in llama.cpp, vLLM, Ollama, Unsloth and LM Studio. A smaller Bolt E4B for conversational agents is due later this month.
Why it matters
A capable agent model that fits in 24GB puts it within reach of 24GB and 32GB graphics cards, not only 128GB unified-memory machines. Keep in mind that 2-bit quantization trades some quality for size, so leave headroom for context if you plan long agent sessions.