I'm trying to figure out the best long-term upgrade path for my setup. Right now my GPUs are spread across several consumer PCs: Main: 5900X, 32GB DDR4, 2× RTX 3090 24GB. Secondary: i3-10320, 16GB DDR4, 2× RTX 3060 12GB. Daily driver: 5800X3D, 64GB DDR4, RTX 3080 10GB. Other hardware: Another RTX 3060 12GB (potentially to be put into main as a separate 3rd GPU and an i7-9700 mini-PC running various Docker services) Currently trying out Swift1.5 Qwen3.8-27B FP8 @ vLLM on the 3090s at speeds I'm pleased with, with smaller models for embeddings, reranking and background tasks on the secondary server. Most usage is coding agents, including concurrent agent workflows and long-context tasks. Long-term, I'm thinking I want to test out larger MoEs, support more concurrent agents and have enough flexibility to test/run newer models. One option I'm considering is an auction for a used Supermicro workstation, likely an AS-5014A-TT with an M12SWA-TF WRX80 motherboard, Threadripper PRO 3000WX/5000WX CPU (exact model unknown), 8 populated DDR4 slots (capacity unknown), eight-channel DDR4-3200, six PCIe 4.0 x16 slots, a 2000W PSU and an RTX 4090. It could potentially accommodate six GPUs using risers and external mounting. Expected total price is ~$6,275 based on previous auctions the last months. I could sell the RTX 4090 for ~$2,300, leaving approximately $4,000 for the workstation itself. The system powers on but hasn't been properly tested as per the auction description. Might be a sketchy bet. -_- I'm still waiting on a reply from the auctioneers if it's possible to get more hardware info. Current local used GPU prices (USD equivalent): RTX 3090 24GB: $1,250+ RTX 3060 12GB: $260–365+ RTX 5060 Ti 16GB: $680+ RTX 4090 24GB: $2,300+ I'm trying to decide whether consolidating everything into a dedicated 4-6 GPU server makes more sense than continuing to upgrade separate consumer PCs. I'm also considering used EPYC DDR4/DDR5 platforms, but there's really not a lot available here and then I'd have to look at importing and all the hassle that brings. I don't have a fixed budget. I'm trying to understand which upgrade paths actually make sense before deciding how much to spend. My main concern is spending a lot of money on a platform that becomes a poor choice and a regret within 1-2 years. Of course impossible to predict the future, but yeah. What would you do in my position? Slap yourself in the face, realize that you're entering AI psychosis and need help or accept the fate that AI psychosis = reality we live in now and just go balls deep? Or are there other angles I haven't considered? Essentially I've just replaced bad drug addictions with a new, more expensive addiction, but at least I can pretend this is productive. I swear it feels like getting into local LLMs = that fucking brain tadpole from Baldur's Gate 3. At first it feels like you're gaining awesome powers, next thing you know it's consumed your brain, you're desperately searching for more hardware and you're hearing voices: "just one more 3090." "48GB VRAM isn't enough, you need 96." "you could fit another GPU in there with a riser." "it's not an addiction, it's infrastructure." "four 3090s would actually be more power efficient." Narrator: "You feel a familiar presence stirring behind your eyes. It offers you power beyond mortal comprehension." Tadpole: "There's a used 3090 on marketplace." /cries in despair   submitted by   /u/infectiousstupidity [link]   [comments]