Howdy All, more test results from my b65 rig! This time I'm focusing more on what one single B65 can do, specifically 1x B65 with XeStrata. I threw in my A6000 for comparison, and I have to say, surprising how well B65 stacks up if you have the system ram to offload. Now my A6000 with Strata is faster, but when I'm using flash-next in librechat, 60 Tok/s feels fast... and when I compare the price to my A6000... I really start to question my setup. I think people really need to give the intel lineup a 2nd look, a lot has changed in only 6 months and even with this recent price bump, it's still the best entry level stack I've found. Graphs on my site: https://b65.thekaiser.us/by-model/qwen38-flash-next/xestrata-20261030/ How was AI used? I wrote what's above, I build the tests, or get them from vetted sources, AI monitors their execution. AI Summary of my testing data: Qwen3.8-Flash-Next: One B65 · XeStrata 4-bit Flash-Next on one 32 GB card with experts in host RAM. Faster for one user; more users queue behind each other. 1x B65: speed and waiting time Median of three measured requests. Multi-user tok/s is aggregate across users. Single-user runs are Verified by Localmaxxing; concurrent runs are unverified. Output falls as users queue, Aggregate output (tok/s) by Users at once Setup 1 2 4 One B65 · tuned XeStrata 62.4 48.7 44.6 First-token wait grows, Time to first token (seconds) by Users at once Setup 1 2 4 One B65 · tuned XeStrata 2.10 5.20 11.4 Results (tok/s, median of 3 measured requests) Run Settings Users tok/s TTFT LocalMaxxing u4x-t-c1 tuned: SPEC_MIN_P 0.6, VRAM reserve 1024 MiB, MAX_CONTEXT 65536, PCIE_FRAC 0.5 (the 61.0 IQ3_S run's settings) 1 62.4 2.1 s Verified, cmvvay4210pqbs601m4prw5t8 u4x-t-c2 tuned 2 48.7 aggregate 5.2 s unverified (concurrency), cmvvay8z70pqhs601kski9lk7 u4x-t-c4 tuned 4 44.6 aggregate 11.4 s unverified (concurrency), cmvvaybe90pqks601goocrtlr u4x-d-c1 recipe defaults 1 57.5 2.2 s Verified, cmvvay6e40pqes60146qql6s0 Same 4-bit files, different serving setups Historical comparison supplied by the campaign. The final IQ3_S row uses a different quantization; older B65 rows carry the contention caveat above. Engines and host environments differ; this does not isolate GPU performance. Same UD-IQ4_XS files · two complete setups, Aggregate output (tok/s) by Concurrent users Setup 1 2 B65 · XeStrata 62.4 44.6 A6000 · llama.cpp MTP-2 52.8 75.2 Against the other Flash-Next UD-IQ4_XS results Rig, engine 1 user 4 users Source B65, XeStrata (this round) 62.4 44.6 above RTX A6000, llama.cpp b11889 + MTP-2 52.8 75.2 cuda-vm ranking round RTX A6000, llama.cpp --fit, no MTP 41.3 — cuda-vm round B65, llama.cpp SYCL, experts in RAM 17.9 18.8 b65-vm round B65, XeStrata, ISTA IQ3_S (tuned) 61.0 47.1 b65-vm round Full page, with interactive charts and the raw data behind every number: https://b65.thekaiser.us/by-model/qwen38-flash-next/xestrata-20261030/   submitted by   /u/SamSausages [link]   [comments]