Latest developments

Illustration of an open server chassis packed with eight bare graphics modules on two boards, lit in blue with tangled cables

Tom's Hardware: a lawyer runs DeepSeek V4.1 Flash on eight used 2018-era V100 GPUs to keep case files offline

Tom's Hardware covered a homelab build that uses eight used Tesla V100 32GB data center GPUs on two NVLink boards, for 256GB of VRAM, to run a mostly 2-bit DeepSeek V4.1 Flash locally. The builder reports up to 215 tokens per second on code and up to 118 on legal writing, with the cards power-capped to 150 W each. Tom's notes used V100 prices have more than doubled and that the R580 driver branch is the last to support these cards.

Why it matters

Old data center GPUs can be a way to get a lot of fast VRAM in one machine, but they bring real tradeoffs: server-style boards and cabling, heavy power draw, a driver branch that's ending, and used prices that are climbing as others catch on.

Source: Tom's Hardware tomshardware.com
  • gpu
  • memory

More news

All news