The PS5 has 16GB GDDR6 on a 256-bit bus at 448 GB/s, the same bandwidth as a 5060 Ti 16GB. Used ones go for roughly $350-450, and there's a Linux loader for it: https://github.com/ps5-linux/ps5-linux-loader I know a chunk of the RAM goes to the OS, so say ~14-15GB is realistically usable. That still fits a ~11GB quant of a 27B model https://huggingface.co/ukisai/Swift-1.5-Qwen3.8-27B-GSQ-RCO-GGUF with a small, heavily quantized KV cache. Napkin math: token generation is mostly bandwidth-bound, so 448 GB/s over an ~11GB model should give an upper bound somewhere around 20-30 tk/s, and real-world will be lower. For reference, people running the BC-250 (the same family of silicon, cut down) are already getting decent results on 12B-class models, and the PS5 is a stronger version of that. The things I don't know and would love input on: Does Vulkan/RADV work properly on the PS5 GPU under Linux? How much RAM is actually usable after the OS/loader? Has anyone run llama.cpp on it yet? If anyone's tried this, I'd love to see numbers.   submitted by   /u/Sad-Expression9157 [link]   [comments]