"--expert-cache", "2000", "--prefill", "auto", "--spec", "2", "--max-context", "176128", "--kv", "q4_0", "--resident-experts", "--kv-resident", "20480", "--pcie-frac", "0.00", "--spec-min-p", "0.70", "--adapt-every", "1", "--adapt-swaps", "80", "--adapt-decay", "0.97", "--vram-reserve-mib", "300" the tweak that worked to fix prefill is sacrificing mtp which had very little impact for me and caching 2000 experts. best model I have ever run on this hardware. no tool call issues no looping. even run past 3 compactions when I was doing 192k context but for that you will have to cache less experts. I have run into no issue so if you will use you do your own tests and judge. 3070 and 32gb ddr4   submitted by   /u/campaigner_ [link]   [comments]