GigaToken: ~1000x faster Language model tokenization

Wait 5 sec.

Comments