I historically get about 6-8 t/s on my MI50 on Qwen @ Q6 running local coding. Building a script that sets my fans all on 100% duty cycle (and much louder) bumps that immediately to like 12 t/s. Letting the machine sit and cool for a while with the fans running, and running inference again... 17-20 tk/s for the first 10 minutes or so. I'm considering putting in water cooling and a great big radiator now what a difference. What a huge difference cooling makes.   submitted by   /u/bigattichouse [link]   [comments]