Libraries tagged by tokenized
robinthehood/tokenizer
837 Downloads
With Tokenizer you can easily convert a string to a stream or array of tokens.
pierotto/tokenizer-bundle
3 Downloads
The package is used for secure data exchange between two parties using a JWT token.
picios/tokenizer
8 Downloads
Easy uri tokens creator and validator
phpfacile/string-tokenizer
40 Downloads
Library to parse a string (especially to extract text and keywords identified by a begin and end delimiter and to substitute keywords by values)
philwaters/tokenizer
12 Downloads
Simple wrapper class around PHP's built in tokenize functions'
osirisgate/tokenizer
20 Downloads
Osirisgate token management.
org_heigl/tokenizer
2266 Downloads
Provides a way of tokenizing strings
nocika/gpt3-tokenizer
15 Downloads
PHP package for Byte Pair Encoding (BPE) used by GPT-3.
nexxes/tokenizer
40 Downloads
Simple tokenizer to split a character steam (text) into character classes (tokens) written in PHP
neuron-core/tokenizer
3 Downloads
High-Performance Tokenizer implementation in PHP
lalbert/tokenizer-engine
18 Downloads
Tokenize string like Elasticsearch
katmore/php-tokenizer
27 Downloads
composer.json
jundayw/tokenizer
1 Downloads
Laravel Tokenizer provides a multi-role, multi-scenario authentication system for SPAs and APIs.
juanchosl/tokenizer
12 Downloads
A small collection of encoder/decoder Token for authentication
jared/php-tokenizer
12 Downloads
This package provides a simple standalone regular expressions powered tokenizer.