Picking up my 4th RTX 3090 tomorrow and am thinking of switching over to Qwen3.8 Flash Next as my daily driver. I've been using VLLM with Qwen3.8-27b and have been happy with it running at ~100+ tps and ~3000 tps prefill, but am worried I am missing out on better intelligence and faster task completion. Strata was my first choice of engine, but at 96GB VRAM it looks like I might be able to fit the whole model in VRAM at 4-bit (maybe). Just curious what engine you would use for this setup? Usually I just use whatever setup I find at club-3090 because they typically have all the bugs worked out ahead of time. But I am open to other options. Thank you for your time :)   submitted by   /u/Civil_Fee_7862 [link]   [comments]