Libraries tagged by tokenizer
kevintweber/html-tokenizer
47398 Downloads
Will tokenize HTML.
h4kuna/latte-php-tokenizer
16953 Downloads
Transform macro args to array.
simpletools/functionparser
17527 Downloads
Function parser for PHP functions, methods, and closures
phplrt/lexer-contracts
143551 Downloads
A set of phplrt lexer abstractions
hexydec/tokenise
8466 Downloads
A program for performing lexical analysis, written in PHP
herrera-io/annotations
127424 Downloads
A tokenizer for Doctrine annotations.
mistralys/jtokenizer
6336 Downloads
Modernized, composer compatible version of Tim Whitlock's JTokenizer PHP Javascript parser and tokenizer library.
fi1a/tokenizer
3959 Downloads
Лексический анализатор строк (tokenizer). Разбор входной последовательности символов на распознанные группы (лексемы).
tsukasa/php-tokenizer
22837 Downloads
Polyfill for php extension Tokenizer
ride/lib-tokenizer
7411 Downloads
Tokenizer library of the Ride framework.
turanjanin/serbian-language-tools
2022 Downloads
Set of tools for tokenization, transliteration and diacritic restoration of a text written in Serbian language.
tacoberu/bnf
2683 Downloads
Framework for building BNF like parsers.
popsul/php-token-reflection
77368 Downloads
Library emulating the PHP internal reflection using just the tokenized source code.
hybridlogic/classifier
1445 Downloads
A Naive Bayesian classification library for PHP with support for different tokenizers to optimize string classification.
didix16/php-grammar
7420 Downloads
A simple library for make Lexer and Parsers to build a language