common : add --spec-draft-n-ubatch by ggerganov · Pull Request #30459 · ggml-org/llama.cpp

Wait 5 sec.

a new option to optimize your VRAM   submitted by   /u/jacek2023 [link]   [comments]