Libraries tagged by tokenizer
taufik-nurrohman/minify
1 Downloads
Reduce CSS, HTML, JavaScript, JSON, PHP, and XML code size on the server side.
scheldejonas/phpunit-php-token-stream
206 Downloads
Wrapper around PHP's tokenizer extension.
octava/code-generator
1 Downloads
PHP code generator
nexxes/tokenmatcher
9 Downloads
PHP library to match tokenstreams (arrays of tokens) for later parsing.
muhfirdaus19/bahasata
6 Downloads
Text Processing PHP bahasa indonesia
megao-phpunit/php-token-stream
40 Downloads
Wrapper around PHP's tokenizer extension.
jamesfrost/statistical-classifier
2678 Downloads
A PHP implementation of Complement Naive Bayes and SVM statistical classifiers, including a structure for building other classifier, multiple data sources and multiple caching backends
guanhui07/tiktoken
6 Downloads
PHP version of tiktoken
gorriecoe/silverstripe-sreg
132 Downloads
Simple tokenizer that allows you to use .ss template like variables in a dataobjects string.
fourkitchens/tiktoken
0 Downloads
PHP version of tiktoken
djiele/autoloader
7 Downloads
Another class loader using PHP tokenizer
attla/token
1 Downloads
Turn everything into a unique encrypted JWT.
attla/data-token
16 Downloads
Turn everything into a token: randomized or predictable.
apemsel/attributed-string
552 Downloads
A collection of fast and easy to use attributed string classes for PHP. Attributed strings can have multiple attributes for each character of the string and are for example used for word processors and natural language processing.
kornrunner/php-token-reflection
6966 Downloads
Library emulating the PHP internal reflection using just the tokenized source code.