Soooo I currently have 4*8Gb of DDR4 3200mhz cl16 RAM modules. I usually run Swift Qwen 27B in IQ4 quant from Bartowsky (the goat himself) on my 7900XT (40tks with mtp) for daily stuff, researches and code when I'm out of work token for work related stuff. I would love to be able to run a more efficient and more accurate model like an MoE in Q8 like Qwen Flash Next that utilizes all my hardware instead of solely my 7900XT because 20Gb of vram is just not enough for higher accuracy quants for dense models. So I found some 2*32Gb DDR4 3200mhz cl16 RAM modules in second-hand at 300€ and will pair it with my existing ones to get 80Gb of RAM. Do you think this is a good idea? Are MoEs really that good compared to lower quant dense models? What is your setup? I mean real setup that went from gaming rig to AI serving server. Please help a man in doubts   submitted by   /u/quadra-lab [link]   [comments]