Latest developments

Illustration of three unbranded mini PCs on a dark desk linked in a triangle by glowing blue cables, with a neural-network pattern of light between them

Microsoft previews RDMA over USB4, letting several Windows PCs run one AI model together

Microsoft announced a developer preview that links two or more USB4-capable Windows PCs with plain USB4 cables so one model can be split across their combined memory and GPU compute. It uses the Windows NetworkDirect RDMA interface and an open-source llama.cpp-based testbed, and is coming soon to Windows Insiders in the Experimental channel. In Microsoft's post, three Ryzen AI Max mini PCs with 128GB each ran Qwen3-235B-A22B at 4-bit at about 18.5 tokens per second.

Why it matters

Models too big for one machine no longer need a server or special network cards: two or three unified-memory mini PCs can pool their memory over USB4. It is an early preview that needs test signing and a registry change, so buy for what one machine runs today, but fast USB4 or Thunderbolt ports and plenty of unified memory now add room to grow.

Source: Microsoft Tech Community (Microsoft USB Blog) techcommunity.microsoft.com
  • ai-pc
  • strix-halo
  • software
  • memory

More news

All news