Libraries tagged by tokenzie
laurynasgadl/travers
457189 Downloads
Travers - PHP array traversing via tokenized paths
your1/tokenizer-x
272 Downloads
TokenizerX calculates required tokens for given prompt
tsukasa/php-tokenizer
22692 Downloads
Polyfill for php extension Tokenizer
ride/lib-tokenizer
7322 Downloads
Tokenizer library of the Ride framework.
mathematicator-core/tokenizer
4474 Downloads
Math Tokenizer
kerasai/behat-tokenizer
20144 Downloads
Token replacement for Behat test suite.
funivan/php-tokenizer
38454 Downloads
Wrapper around token_get_all. Easy to extract and modify php code.
fi1a/tokenizer
3830 Downloads
Лексический анализатор строк (tokenizer). Разбор входной последовательности символов на распознанные группы (лексемы).
aisk/mistral-tokenizer
46 Downloads
PHP implementation of Mistral's tokenizers
turanjanin/serbian-language-tools
2006 Downloads
Set of tools for tokenization, transliteration and diacritic restoration of a text written in Serbian language.
tacoberu/bnf
2640 Downloads
Framework for building BNF like parsers.
popsul/php-token-reflection
77305 Downloads
Library emulating the PHP internal reflection using just the tokenized source code.
hybridlogic/classifier
1442 Downloads
A Naive Bayesian classification library for PHP with support for different tokenizers to optimize string classification.
html5/htmlreader
3299 Downloads
Html5 stream tokenizer/reader (not using libxml)
didix16/php-grammar
7276 Downloads
A simple library for make Lexer and Parsers to build a language