Libraries tagged by tokenizer
simpletools/functionparser
12596 Downloads
Function parser for PHP functions, methods, and closures
phplrt/lexer-contracts
138303 Downloads
A set of phplrt lexer abstractions
hexydec/tokenise
7712 Downloads
A program for performing lexical analysis, written in PHP
didix16/php-grammar
7071 Downloads
A simple library for make Lexer and Parsers to build a language
camspiers/statistical-classifier
36979 Downloads
A PHP implementation of Complement Naive Bayes and SVM statistical classifiers, including a structure for building other classifier, multiple data sources and multiple caching backends
apicart/fql
10042 Downloads
Filter Query Language
rahul900day/gpt-3-encoder
22921 Downloads
GPT-3-Encoder is a PHP implementation of OpenAI's original python encoder/decoder.
herrera-io/annotations
127310 Downloads
A tokenizer for Doctrine annotations.
mistralys/jtokenizer
5665 Downloads
Modernized, composer compatible version of Tim Whitlock's JTokenizer PHP Javascript parser and tokenizer library.
mathematicator-core/tokenizer
4452 Downloads
Math Tokenizer
fi1a/tokenizer
3616 Downloads
Лексический анализатор строк (tokenizer). Разбор входной последовательности символов на распознанные группы (лексемы).
ride/lib-tokenizer
7252 Downloads
Tokenizer library of the Ride framework.
kerasai/behat-tokenizer
20069 Downloads
Token replacement for Behat test suite.
gollumsf/url-tokenizer-bundle
1594 Downloads
Simple url tokenizer
tacoberu/bnf
2558 Downloads
Framework for building BNF like parsers.