Libraries tagged by tokenize

jojo1981/json-ast-builder

3 Favers
6 Downloads

Json AST builder

yurunsoft/tiktoken

0 Favers
241 Downloads

PHP version of tiktoken

xtreed/php-token-stream

0 Favers
3534 Downloads

Wrapper around PHP's tokenizer extension.

vchagin/superclosure

2 Favers
65 Downloads

Serialize Closures, including their context

td7650/superclosure

0 Favers
58 Downloads

Serialize Closure objects, including their context and binding

scheldejonas/phpunit-php-token-stream

0 Favers
208 Downloads

Wrapper around PHP's tokenizer extension.

octava/code-generator

0 Favers
1 Downloads

PHP code generator

nexxes/tokenmatcher

0 Favers
9 Downloads

PHP library to match tokenstreams (arrays of tokens) for later parsing.

muhfirdaus19/bahasata

1 Favers
6 Downloads

Text Processing PHP bahasa indonesia

megao-phpunit/php-token-stream

1 Favers
44 Downloads

Wrapper around PHP's tokenizer extension.

legacyphpdoctor/tiktoken-php-7-4

1 Favers
3 Downloads

PHP version of tiktoken

jamesfrost/statistical-classifier

1 Favers
2680 Downloads

A PHP implementation of Complement Naive Bayes and SVM statistical classifiers, including a structure for building other classifier, multiple data sources and multiple caching backends

html5/htmlreader

1 Favers
3299 Downloads

Html5 stream tokenizer/reader (not using libxml)

hike/hike

1 Favers
5 Downloads

A consistent interface to tokenize, analyse and modify any text format. Programming languages, natural languages, markup languages

guanhui07/tiktoken

1 Favers
6 Downloads

PHP version of tiktoken

<< Previous Next >>