Qwen3.8-27B at 256K on a 24GB RTX PRO 4000 SFF (432 GB/s): 50 tok/s with MTP

Read post on hnrss.org

Article URL: https://piszczek.pl/blog/qwen38-27b-256k-50-tps-24gb-gpuComments URL: https://news.ycombinator.com/item?id=49331607Points: 9# Comments: 2