Libraries tagged by tokenize
ricwein/tokenizer
1034 Downloads
configurable string tokenizer
osirisgate/tokenizer
20 Downloads
Osirisgate token management.
irfan-chowdhury/bkash-tokenized-checkout
28 Downloads
This is a bkash tokenized payment gateway solution with laravel. Integrate with the payment solution that fits all business needs and Enrich the customers' online payment experience.
gollumsf/url-tokenizer-bundle
1674 Downloads
Simple url tokenizer
funivan/php-tokenizer
38455 Downloads
Wrapper around token_get_all. Easy to extract and modify php code.
everstu/gpt3-tokenizer
133 Downloads
PHP package for Byte Pair Encoding (BPE) used by GPT-3.
yannickl88/css-tokenizer
30838 Downloads
CSS tokenizer
sastrawi/tokenizer
946 Downloads
PHP library that allows you to tokenize Bahasa Indonesia.
hippophp/tokenizer
1108 Downloads
Wrapper around token_get_all
vanderlee/comprehend
16 Downloads
Framework for building BNF LR(1) parsers
teepluss/wordbreaker
25 Downloads
Word breaker is Thai wording separator for using with fulltext software.
rudl/logger
2669 Downloads
Rudl UDP cluster logging library (PSR4 compliant)
phpwatch/phptoken-polyfill
17 Downloads
A polyfill for PHP 8.0's PhpToken class
patchwork/php-parser
26 Downloads
Fast and extensible PHP code analysis and transformation
dbeurive/lexer
2395 Downloads
This project implements a simple lexer.