Hardware : 4× NVIDIA RTX 3090 , all pcie x16 256GB DDR4 Engine : Maya https://github.com/mw00/project-maya model : orcarouter/DeepSeek-V4.1-Flash-1017-abliterated-GGUF ( mix-256G) at 524k context Prefill : 400 – 600 tok/s Decode : 30 – 40 tok/s (peaking up to 60 tok/s) ( with dspark ) Hi, everyone i'm still playing around with the model comparing it mostly to qwen 3.8 next flash (Q8 ) , and trying to keep myself busy until we get qwen 4 .So far i find the model doesn't loop as much as the previous version (0731), i also tried to run it at Q8 but it's really slow ( 6-8tok/sec decode , 65tok/s prefill ) .I still prefers to use qwen just for the speed i get with agentic task . Curious to hear what kind of speeds others are getting with similar multi-GPU rigs or different engine ( didn't set up xolotl yet , and strata seems to use the same engine as maya for deepseek )?   submitted by   /u/chota23 [link]   [comments]