Hi everyone, I have an Nvidia GeForce 5060ti with 16GB of VRAM, Ryzen 5700g CPU, 64GB of DDR4 ram, and a bunch of SSDs. I keep seeing people posting of running Qwen3.6-35b-a3b on the same GPU I have with insane amount of context. So far I only got it to 64k with offloading of moe at 74 in Ollama. I want to get it to at least 120k or even max context, while keeping my quant at q4_k_m or there abouts (e.g. IQ4). What do you all recommend? A little further details : The reason for using Ollama, is that I can have my system load the LLM and process a request or requests, and then offload it to load a model in ComfyUI to process image requests and then swap back to the LLM for further requests - if any. It works nicely for me as a local ChatGPT style setup with OpenWebUI. This setup is also running on my gaming PC, so the offloading also helps free up VRAM for gaming purposes. I appreciate the help and advice.   submitted by   /u/technofox01 [link]   [comments]