Kimi K3 full model running on 16x GB10 cluster at 20+tps

Wait 5 sec.

Kimi K3 full model running on 16x GB10 cluster at 20+tps average (llama-benchy coherent corpus) 38tps peak, 750tps prefill. This is the first run of full k3 with dspark on my cluster. I will be doing some tests and try tp speed this up. As soon as it looks ready I'll publish the vllm image and instructions. https://forums.developer.nvidia.com/t/full-kimi-k3-running-on-16x-gb10-cluster/379174   submitted by   /u/ciprianveg [link]   [comments]