Is it worth $800 for this Setup, or should I stick with the one I already have?

Wait 5 sec.

Intel Xeon E5-2680 v4 14C/28T 128GB RAM DDR4 2,400 MHz Dual Channel 2× PCIe 3.0 x16 PSU 650 W SSD M.2 512GB For $800, is it worth it? I currently have 24 GB of VRAM (Nvidia 3090) and 32 GB of DDR4 RAM. I’ve been using Qwen 3.8-27B in 4-bit quantization. If I buy this PC, I would basically have 24 GB VRAM + 128 GB RAM, which means I could run Qwen Flash in 3-bit quantization or maybe 4-bit with offloading (Strata), but I’m not 100% sure if it’s worth it. I’d have to buy a bigger PSU (maybe around 850 W) to connect the 3090, which increases the initial price. The memory is dual-channel, not quad-channel, and the motherboard doesn’t support more than 128 GB if I wanted to increase that amount in the future. The only way would be to connect a second GPU (I don’t have the money for a new 3090, so the only viable option would be an Nvidia 3060 12 GB). I use AI to create images, videos, transcribe audio, translate books, subtitle videos, program, and in general for all kinds of AI projects. Is it worth running an MoE in RAM? The other option is to pay $350 for 64 GB of RAM for my current machine (which is the maximum it supports). I think with that I could still run Strata at 2-bit or 3-bit.   submitted by   /u/Juan_Phoenix7 [link]   [comments]