I'm running Linux Mint on a Lenovo Legion with an NVIDIA RTX 5090 Laptop GPU (24 GB VRAM). When running local LLMs, I encounter GPU hangs associated with NVIDIA Xid 8. I initially wondered whether this was a hardware problem, but I found a directly relevant llama.cpp issue describing CUDA graph evaluation hangs and Xid 8 on an RTX 5090 Laptop GPU under Linux: https://github.com/ggml-org/llama.cpp/issues/27330 That report identifies GGML_CUDA_DISABLE_GRAPHS=1 as a workaround. Kinda frustrating that it's not getting fixed, and the workaround is to slow down performance. I'm running 7.1.13 kernel with my audio drivers added. I couldn't run 7.2, I couldn't get nvidia drivers to play nice with it. 7.3 is supposed to have my audio drivers in it, but then there's the will it work with nvidia drivers question. I'm running 595.99.02, I couldn't get the newer drivers to work either.   submitted by   /u/SOC_FreeDiver [link]   [comments]