sudoing posted that he's loaded Ling 3.1 Flash across four DGX Sparks. It's a 560B MoE with 25B active parameters per token. He'd enjoyed the earlier Ling models and wanted to test this one, but it wouldn't fit on his two Sparks with the setup he was trying. someone in Germany gave him access to a four-Spark setup. He's using Atomic Chat's day-one Q4 GGUF, distributed across all four machines through llama.cpp RPC. According to his post, there wasn't an official FP4 build for vLLM available at the time, which is why he went with this route. No performance numbers in the screenshot yet. He expects bandwidth and speed to be painful, but wants to see how it compares with the 124B Ling 3.0 Flash. That's the comparison I'm interested in too: how much the larger model changes answer quality, and what the waiting time looks like in actual use. Links for anyone following along: Atomic Chat's Ling 3.1 Flash GGUF repository llama.cpp Official Ling 3.1 Flash model   submitted by   /u/BerryBlush_Rogers691 [link]   [comments]