I am using a consumer motherboard that clearly is not designed to support 4xGPU setups. Asus Proart Creatio B850 Neo, so I'm very limited in the PCIe lanes I can use. Current Setup 32GB DDR5 @ 6000mhz Two 3090s running Qwen3.8-27b in Tensor Parallel 1. PCIe Gen4 8x - RTX 3090 - Founders Edition 2. PCIe Gen4 8x - RTX 3090 - Dell OEM Image Processing Tasks 3. PCIe Gen4 4x - RTX 3090 - EVGA FTW3 Ultra Not Connected Yet 4. PCIe Gen4 1x - RTX 3090 - Dell OEM Plan: My original plan was to setup the two Dell OEM 3090s using NVLink to boost the speed of Qwen3.8-27b. But I am thinking of moving to using Qwen3.8 Flash Next with resident experts in VRAM. i.e. Rather than keeping experts in system RAM. Keep as much as possible in VRAM, since I have more VRAM than I do ram. I realise this is becoming a Frankenstein setup, and plan to upgrade to a proper workstation motherboard soon. But I wanted to get just enough VRAM to test out Qwen3.8 Flash Next, and 3x3090s should be enough to do that, (even with only 32GB ram). Question: I just ordered a PCIe Gen4 1x-to-16x adapter so that I can plug in the forth GPU, but am a bit worried about how Gen4 1x speeds will limit me with Strata. I know Strata is designed to use Expert parallelism / pipeline parallism instead of tensor parallelism, but am concerned it'll still be too slow. Has anyone else here run one of their GPUs in Gen4 1x speeds with Strata? What were your speeds like?   submitted by   /u/Civil_Fee_7862 [link]   [comments]