Libraries tagged by cl100k_base
rajentrivedi/tokenizer-x
89 Favers
118409 Downloads
118409 Downloads
TokenizerX calculates required tokens for given prompt
danny50610/bpe-tokeniser
9 Favers
277982 Downloads
277982 Downloads
PHP port for openai/tiktoken (most)
your1/tokenizer-x
0 Favers
273 Downloads
273 Downloads
TokenizerX calculates required tokens for given prompt