Local RAG on Mac: index 1M embeddings in about 10s on an Apple M-silicon GPU through MLX

Wait 5 sec.

https://preview.redd.it/myi9ex21n11i1.png?width=1200&format=png&auto=webp&s=2e1867c76c211d86f388242c4e84353d90fcd872 cuVS for your Mac. GPU vector search on Apple silicon, built on MLX. 1M vectors indexed in 10 s on a MacBook Pro, then 70k queries/s at 97.6% recall, 2x compared to CPU HNSW https://github.com/mikepapadim/mlxvs   submitted by   /u/mikebmx1 [link]   [comments]