Libraries tagged by cl100k_base
rajentrivedi/tokenizer-x
89 Favers
112057 Downloads
112057 Downloads
TokenizerX calculates required tokens for given prompt
danny50610/bpe-tokeniser
9 Favers
263478 Downloads
263478 Downloads
PHP port for openai/tiktoken (most)
your1/tokenizer-x
0 Favers
272 Downloads
272 Downloads
TokenizerX calculates required tokens for given prompt