Hi, I'm a bit of a noob when it comes to running local LLMs, I have tried a few things, but everything was miserably slow on my setup. I have an RTX5070 with 64g system memory. Recently I have experimented with unsloth, tried a few model messed with settings, bit it only gotten worse. I feel like I can achieve something better than half an hour to an hour response time for anything non trivial. Could you help me with recommendation on which model/setup should I try to achieve a usable speed? Or if you could direct me where to even try to look I would be grateful. (I tried to search the sub, but all I found was related to 5070 TI   submitted by   /u/VoidRippah [link]   [comments]