Use balena etcher or whatever to mount to USB stick, boot. Test. Report. Verified 5-25% faster than llama.cpp, system uses 90% of card bandwidth as opposed to 80% on my 7900xtx. I there is code for nvidia, intel, amd, and chinese hardware and supports 20 lanuages.   submitted by   /u/W61k3r [link]   [comments]