Microsoft previews RDMA over USB4, letting several Windows PCs run one AI model together
Microsoft announced a developer preview that links two or more USB4-capable Windows PCs with plain USB4 cables so one model can be split across their combined memory and GPU compute. It uses the Windows NetworkDirect RDMA interface and an open-source llama.cpp-based testbed, and is coming soon to Windows Insiders in the Experimental channel. In Microsoft's post, three Ryzen AI Max mini PCs with 128GB each ran Qwen3-235B-A22B at 4-bit at about 18.5 tokens per second.
Models too big for one machine no longer need a server or special network cards: two or three unified-memory mini PCs can pool their memory over USB4. It is an early preview that needs test signing and a registry change, so buy for what one machine runs today, but fast USB4 or Thunderbolt ports and plenty of unified memory now add room to grow.