Libraries tagged by tokenize
teepluss/wordbreaker
25 Downloads
Word breaker is Thai wording separator for using with fulltext software.
rudl/logger
2387 Downloads
Rudl UDP cluster logging library (PSR4 compliant)
phpwatch/phptoken-polyfill
17 Downloads
A polyfill for PHP 8.0's PhpToken class
paulorlima9/php-token-stream
11 Downloads
Wrapper around PHP's tokenizer extension.
patchwork/php-parser
26 Downloads
Fast and extensible PHP code analysis and transformation
html5/htmlreader
3252 Downloads
Html5 stream tokenizer/reader (not using libxml)
dbeurive/lexer
2287 Downloads
This project implements a simple lexer.
crazzy501/gpt-3-encoder-php
297 Downloads
PHP BPE Text Encoder/Decoder for GPT-2 / GPT-3. Based on coderevolutionplugins/gpt-3-encoder-php
chrismcmacken/phptools
3558 Downloads
Small utilities that assist in developing applications
antto1/superclosure
152 Downloads
Serialize Closure objects, including their context and binding
masnathan/sql-query-formatter
1700 Downloads
A very lightweight PHP class that reformats unreadable and computer-generated SQL query statements to human-friendly, readable text.
robo47/php-manipulator
8 Downloads
Manipulation of php code, automated refactoring based on phps tokenizer
risototh/search-query-composer
9910 Downloads
Tokenizer and composer for search query from user input.
mfalemany/php_codesniffer
9 Downloads
PHP_CodeSniffer tokenizes PHP, JavaScript and CSS files and detects violations of a defined set of coding standards.
ecomdev/magento-translate-tool
6 Downloads
Magento translation tool that utilizes PHP Tokenizer in order to generate csv files from PHP, XML, PHTML code