Just pushed a PR for dwarfstar that adds support for Deepseek-v4.1-Flash-1017 with its new engrams and updated vision tower. The PR basically just adds compatibility for the file revisions and checks to make sure the vision+language model file combination matches, raising on mixed pairings. Any files quantized with the ds4 quantization suite will load without any special changes, and it introduces no regressions for the previous checkpoint. This is a major revision, with ~40% of the routed expert tensors changed, 30% in the engrams, and ~50% of the vision tower's expert tensors changed. The architecture remains the same, so it just slots into the existing kernels with no changes to the core code once it's implemented in the PR. Shortly, I will be uploading my Q2-Q8 mixed quant for 128GB w/ minor SSD offloading (152GB wired, 366GB total with engrams, following antirez's recipe for the previous checkpoint), and will make a thread when it's ready. It should decode around 20tps on an M5 Max.   submitted by   /u/returnity [link]   [comments]