Libraries tagged by bpe

yethee/tiktoken

160 Favers
3781608 Downloads

PHP version of tiktoken

gioni06/gpt3-tokenizer

85 Favers
577725 Downloads

PHP package for Byte Pair Encoding (BPE) used by GPT-3.

danny50610/bpe-tokeniser

10 Favers
445562 Downloads

PHP port for openai/tiktoken (most)

mehrab-wj/tiktoken-php

17 Favers
110084 Downloads

a clone of python tiktoken but for PHP! fast BPE tokeniser for use with OpenAI's models.

coderevolutionplugins/gpt-3-encoder-php

100 Favers
50077 Downloads

PHP BPE Text Encoder/Decoder for GPT-2 / GPT-3

linkorb/buckaroo

13 Favers
113510 Downloads

Buckaroo BPE3 API client for PHP. PSR-0 Compliant.

guttedgarden/tiktoken

2 Favers
21418 Downloads

PHP 7.4 version of tiktoken

ze/tokenizer-gpt3

1 Favers
25096 Downloads

PHP package for Byte Pair Encoding (BPE) used by GPT-3.

nfephp-org/sped-bpe

6 Favers
816 Downloads

API para geração e comunicação dos eventos relativos ao projeto BPe.

codewithkyrian/tokenizers

18 Favers
26 Downloads

Fast, pure-PHP tokenizer library compatible with Hugging Face tokenizers for encoding and decoding text

textualization/ropherta-tokenizer

1 Favers
492 Downloads

GPT3Tokenizer (BPE) with Roberta-base vocabulary.

sajjadh47/bpe-encoder-php

4 Favers
30 Downloads

BPE (Byte-Pair Encoding) Encoder Decoder for OpenAI's GPT-2 / GPT-3 Implemented In Pure PHP, Zero Dependency, Multi Byte Supported.

yurunsoft/tiktoken

0 Favers
261 Downloads

PHP version of tiktoken

token27/nexus-ai-tokenizer

0 Favers
25 Downloads

Provider-agnostic LLM token counter for PHP 8.3+. Supports Tiktoken BPE (OpenAI, Claude approx.), HuggingFace JSON vocabularies (DeepSeek, LLaMA, Mistral), SentencePiece (Gemini), and extensible custom strategies.

cxrxexo/tiktoken

2 Favers
2129 Downloads

PHP version of tiktoken. PHP 7.4+ required.

Next >>