Today's update is welcome for us R9700 users (assume other gpu's as well). Prior to the update I was getting ~70 tok/s output with four R9700's and 256GB of system ram. Today's update brings it to 140-160 tok/s and ~3200 prefill running unsloth Q4_K_XL. I tried running Q5 but was like .1 GB of vram short to do split engine so ran it "normal" at ~70 tok/s. I am sure with future updates those numbers will get better but it is a very welcome update, thank you Strata team! Radiance does about 235 tok/s and 7500 prefill with FN so still ahead but so happy to see Strata working to close that gap and giving us more options on which models we can run. https://preview.redd.it/syz0m1a5lbzh1.jpeg?width=2348&format=pjpg&auto=webp&s=15f3fb62de0d73beb3cbb357359ce96fb50ba4ac   submitted by   /u/poofph [link]   [comments]