I was comparing speed and settings between a macbook pro and my 4x RTX3090 rig, with a Q6 Qwen3.6 35b a3b model, with MTP. With 4x RTX3090 I was getting around decode of 70t/s I always thought "MTP must always be faster! right?" To my surprise, on my 4x RTX3090 rig was actually faster with speculative decoding disabled. After disabling MTP I was getting 82t/s But why? MTP’s draft-and-verify step needs extra sync passes across all four GPUs, and since layer-split GPUs already take turns with PCIe hops between them, the verification overhead costs more than the accepted draft tokens save you. So just an FYI, you may already knew, but apparently using multiple GPUs with MTP can cost you some decode speed.   submitted by   /u/macboller [link]   [comments]