I am pretty new to local ai and have been having so much fun with it. I currently have 2 5090s I am using for it. I took one of the 5090s from my gaming pc to use for local AI and now I am hooked on it and don't want to pull it to put back into my gaming PC lol. I was thinking though, I could sell one of the 5090s, put the other back in my gaming pc and then buy 4 R9700's for roughly the price I get for the one 5090 and double the vram I had before. I am curious how will that effect which models I can run and performance running them. Right now I have been using strata and flash next Q5_K_XL and get ~150 tok/s and ~4k prefill. I see I can run strata and flash next with the r9700's as well but what about the future and other models, will I see a big hit in speed leaving the 2 5090s or will doubling the vram more than make up for it? I just don't want to get the 9700's and find I can't run half of the models down the road because the model does not support it or they run poorly.   submitted by   /u/poofph [link]   [comments]