I am building my first local LLM station and considering to start by picking a good graphic card. The V100 is significantly cheaper, but also apparently no longer supported for future CUDA releases. How big of a problem is that considering the current trend of continuous optimizations and findings such as n-grams for MoE, or diffusion models and so on? Still learning here, and genuinely overwhelmed by the pace I have to keep to have even a grasp of what’s going on out there. Thank you in advance!   submitted by   /u/Numerous-Ad6217 [link]   [comments]