Libraries tagged by tokeniser
artemeon/tokenizer
54263 Downloads
Tokenizer for php
kevintweber/html-tokenizer
46245 Downloads
Will tokenize HTML.
h4kuna/latte-php-tokenizer
12717 Downloads
Transform macro args to array.
tacoberu/bnf
2347 Downloads
Framework for building BNF like parsers.
simpletools/functionparser
5853 Downloads
Function parser for PHP functions, methods, and closures
phplrt/lexer-contracts
118103 Downloads
A set of phplrt lexer abstractions
guttedgarden/tiktoken
9949 Downloads
PHP 7.4 version of tiktoken
camspiers/statistical-classifier
36960 Downloads
A PHP implementation of Complement Naive Bayes and SVM statistical classifiers, including a structure for building other classifier, multiple data sources and multiple caching backends
apicart/fql
9561 Downloads
Filter Query Language
udan11/sql-parser
908 Downloads
A validating SQL lexer and parser with a focus on MySQL dialect.
rahul900day/gpt-3-encoder
17303 Downloads
GPT-3-Encoder is a PHP implementation of OpenAI's original python encoder/decoder.
herrera-io/annotations
126939 Downloads
A tokenizer for Doctrine annotations.
mistralys/jtokenizer
4424 Downloads
Modernized, composer compatible version of Tim Whitlock's JTokenizer PHP Javascript parser and tokenizer library.
hostnet/phpcs-tool
134942 Downloads
PHP_CodeSniffer tokenises PHP, JavaScript and CSS files and detects violations of a defined set of coding standards. Hostnet version
ride/lib-tokenizer
6846 Downloads
Tokenizer library of the Ride framework.