Libraries tagged by tokenize
ueef/auth-tokenizer
901 Downloads
thruster/tokenizer
5 Downloads
Thruster Tokenizer Component
textualization/ropherta-tokenizer
77 Downloads
GPT3Tokenizer (BPE) with Roberta-base vocabulary.
soloproyectos-php/text-tokenizer
891 Downloads
A library to split a string into smaller tokens. This library is part of the SoloProyectos PHP API.
sincco/tokenizer
178 Downloads
Create and validate token for user data
scripturadesign/tokenizer
7 Downloads
Tokenizer
robinthehood/tokenizer
833 Downloads
With Tokenizer you can easily convert a string to a stream or array of tokens.
pierotto/tokenizer-bundle
2 Downloads
The package is used for secure data exchange between two parties using a JWT token.
picios/tokenizer
7 Downloads
Easy uri tokens creator and validator
phpfacile/string-tokenizer
39 Downloads
Library to parse a string (especially to extract text and keywords identified by a begin and end delimiter and to substitute keywords by values)
nocika/gpt3-tokenizer
15 Downloads
PHP package for Byte Pair Encoding (BPE) used by GPT-3.
nexxes/tokenizer
40 Downloads
Simple tokenizer to split a character steam (text) into character classes (tokens) written in PHP
m.rahimi/laravel-tokenize-auth
6 Downloads
Generate token for authentication.
lalbert/tokenizer-engine
18 Downloads
Tokenize string like Elasticsearch
katmore/php-tokenizer
27 Downloads
composer.json