Libraries tagged by tokenizer
katmore/php-tokenizer
24 Downloads
composer.json
jared/php-tokenizer
10 Downloads
This package provides a simple standalone regular expressions powered tokenizer.
golding/dns-zone-tokenizer
13 Downloads
tokenize dns zone files and that's all, folks.
dhii/xml-tokenizer-interface
8 Downloads
An interface for XML tokenizers
dhii/tokenizer-interface
164 Downloads
Interfaces for tokenizer interoperability.
dhii/tokenizer-base
8 Downloads
Base concrete functionality for tokenizers
dhii/tokenizer-abstract
44 Downloads
Abstract common functionality for tokenizers.
devtronic/super-tokenizer
62 Downloads
A powerful dynamic tokenizer written in PHP
brunocfalcao/laravel-tokenizer
97 Downloads
Laravel tokenizer - Token usage for web apps (create, burn, check, etc)
athron98/ihas-tokenizer
4 Downloads
iHAS API Token Generator
cyberalien/simple-tokenizer
34 Downloads
Simple CSS tokenizer
yurunsoft/tiktoken
207 Downloads
PHP version of tiktoken
xtreed/php-token-stream
3524 Downloads
Wrapper around PHP's tokenizer extension.
vchagin/superclosure
65 Downloads
Serialize Closures, including their context
td7650/superclosure
57 Downloads
Serialize Closure objects, including their context and binding