Free GPU Taskman tool shows which apps and AI models are using your VRAM
Microsoft VP Scott Hanselman released gputaskman, an open-source, MIT-licensed GPU task manager for Windows, Linux and macOS. Tom's Hardware reports it lists per-process GPU load and VRAM use, and for local LLM servers like llama-server it breaks out the model, its weights and its KV cache. It's labeled experimental, with portable Windows downloads of v0.3.0.
Why it matters
When a model won't fit, the first question is where your VRAM already went. A tool that shows the desktop, the browser and each model's weights and KV cache side by side makes it much easier to judge whether you need a bigger card or just need to close something.