Ehmmm...... yeah. grinded some useful (and meaningfu?l) resources. on my way to run DeepSeek-V3 IQ1\_M (\~1.5-bit to 1.58-bit) >>>>>>>> The model weights take up roughly 130 GB. This leaves us with about 30 GB of breathing room across the cluster to handle KV Cache and context overhead. jarvis, engine ignition on PS: Yeah these cables connection are currently BS and tangled here and there. Gotta fox that. Just commecfed yellow cables or dummies for uhh picture and ig a little...... flex?? 🫠  submitted by   /u/Wise_Huckleberry_902 [link]   [comments]