TL;DR: built a harness for local agentic work. Have 96+24+24GB VRAM & 128GB RAM. Good models for long horizon autonomous agents at that size that beet QFN q6? I've built up a personal harness that's got basic tools, super solid web browsing, and a skills framework + agent-managed crons. It's basically become a metastasized openclaw/my local Muse, and since I built the harness, it works just how I like and I'm pretty liberal with how much (mostly read-only) access I give it. It tracks refunds, monitors for emails I might miss like renewing trials, is GREAT for mining through all my medical records before doc appts, and puts together instacart orders for me. I've recently started trialling Amazon and eBay purchases and it's going great; my latest "hmmmm maybe" experiment is searching for and tracking real estate and government auctions. I've wired up its email and it offloads research labor to two Muse agents I use for free delegated compute when it needs some highly capable gruntwork done fast, but it does just about all of the meat of a given task. I mainly run Qwen Flash Next at q6, although for the agentic work it's a tossup with DSv4F+vision at q8. When I have a task that can deal with an agent dumb as a bag of rocks but that needs to be done FAST, I use Qwen 3.6 35ba3b with Ninfer which does a cool 500tok/s decode. I have 96GB + 24GB + 24GB vram (RTX pro 6000 + 2x3090) and 128gb system ram. Anyone else using models for long horizon agentic tasks in that range have anything they love? Qwen 3.8 27b used to be my driver but it struggles as tasks get longer; many autonomous runs hit 250+ tool uses per turn which is a LOT for a lot of otherwise quite capable coding agents. Other models I've tried like MiMo feel good for coding but fall down when it's driving a browser and updating memories and scheduling future and sending emails all on a single turn. Lighter weight quants feel nice on speed but get careless when the memory with a directive was 80k tokens ago. Would love to hear from folks with a similar all-local setup, what models you use, hacks for long agentic tasks, etc.! I'm kind of souring on QFN; it has random bouts of bizarre and unrelated reasoning. But there's not a great alternative for similar abilities that doesn't drop below 25tok/s, which is about what I consider "usable speed" (most autonomous background jobs complete within ~60 mins). DSv4F gets sloppy with details and hallucination increases a LOT as I push towards context window. What do y'all like for this kind of thing? Bonus pic: the skin I ginned up a few nights ago based on mid to late 2000s web 2.0 design aesthetics. Anyone miss vector flourishes? I feel like a kid again.   submitted by   /u/CharlesStross [link]   [comments]