4x 5060ti16gb 4x 3060 12gb 256gb ddr4 3200 ram (4-channel speeds) On a mobo with 128 pcie4 lanes I’ve been slowly collecting gpus whenever seeing deals over time and ended up with this. Ended up comparable in cost to current prices of dgx spark I was thinking: TP4 5060s -> pipeline -> TP4 3060s -> offload/overflow less used experts to RAM -> keep any engram on nvme ssd Is this viable to run inference with big MoE models at high speed and precision, or are cheaper multigpu setups extremely suboptimal compared to unified vram/ram   submitted by   /u/Ambitious_Fold_2874 [link]   [comments]