Libraries tagged by tokenzie
crazzy501/gpt3-tokenizer
8 Downloads
PHP package for Byte Pair Encoding (BPE) used by GPT-3.
chinleung/tokenizer
591 Downloads
PHP Tokenizer
brunocfalcao/laravel-tokenizer
97 Downloads
Laravel tokenizer - Token usage for web apps (create, burn, check, etc)
bermudaphp/tokenizer
0 Downloads
PHP tokenizer for finding class, interface, trait, and enum declarations
athron98/ihas-tokenizer
4 Downloads
iHAS API Token Generator
atefeboluri/laravel-tokenize-login
10 Downloads
amsterdamstandard/tokenizer
17 Downloads
Tokenizer api wrapper for PHP
akavov/yii2-bootstrap-tokenfield
2407 Downloads
Create elegant taggable fields with copy/paste and keyboard support using Bootstrap Tokefield
affinity4/tokenizer
7 Downloads
A zero-dedpendency tokenizer written in PHP. Returns an easily navigatable Stream object of Token objects with public type, value, offset and length properties
ae8/tokenizer
16 Downloads
A simple PHP library for token-based encryption.
mathewberry/tokenizer
770 Downloads
A very lightweight token system for micro-services
gossi/tokenizer
150 Downloads
Tokenizer for PHP code
fiv/tokenizer
254 Downloads
Extreme and flexible library for parsing and modify php code
cyberalien/simple-tokenizer
38 Downloads
Simple CSS tokenizer
yurunsoft/tiktoken
241 Downloads
PHP version of tiktoken