Libraries tagged by tokenize
cxrxexo/tiktoken
1961 Downloads
PHP version of tiktoken. PHP 7.4+ required.
chrismcmacken/phptools
3558 Downloads
Small utilities that assist in developing applications
masnathan/sql-query-formatter
1671 Downloads
A very lightweight PHP class that reformats unreadable and computer-generated SQL query statements to human-friendly, readable text.
robo47/php-manipulator
8 Downloads
Manipulation of php code, automated refactoring based on phps tokenizer
mich-grodno/php_codesniffer
845 Downloads
PHP_CodeSniffer tokenizes PHP, JavaScript and CSS files and detects violations of a defined set of coding standards.
laurynasgadl/travers
455393 Downloads
Travers - PHP array traversing via tokenized paths
ecomdev/magento-translate-tool
6 Downloads
Magento translation tool that utilizes PHP Tokenizer in order to generate csv files from PHP, XML, PHTML code
hipay/hipay-enterprise-sdk-js
1932 Downloads
The HiPay Fullservice SDK for JavaScript allows you to tokenize credit or debit cards against the HiPay Fullservice payment platform.
philwaters/tokenizer
11 Downloads
Simple wrapper class around PHP's built in tokenize functions'
org_heigl/tokenizer
2266 Downloads
Provides a way of tokenizing strings
dennislindsey/tokenize
21 Downloads
Tokenization Interface
yuubit/tokenizer
401 Downloads
PHP Library to tokenize various inputs.
yep/tokenizer
8 Downloads
Tokenizer
wpscholar/php-tokenizer
2 Downloads
An experiment with using the PHP tokenizer functions.
vanry/tokenizer
2 Downloads
支持 scws, phpanalysis 和 jieba 的中文分词器