Libraries tagged by tokenize

Tokenizer library of the Ride framework.

Go to Download

Token replacement for Behat test suite.

Go to Download

Лексический анализатор строк (tokenizer). Разбор входной последовательности символов на распознанные группы (лексемы).

Go to Download

Set of tools for tokenization, transliteration and diacritic restoration of a text written in Serbian language.

Go to Download

Framework for building BNF like parsers.

Go to Download

Library emulating the PHP internal reflection using just the tokenized source code.

Go to Download

A Naive Bayesian classification library for PHP with support for different tokenizers to optimize string classification.

Go to Download

A simple library for make Lexer and Parsers to build a language

Go to Download

A PHP implementation of Complement Naive Bayes and SVM statistical classifiers, including a structure for building other classifier, multiple data sources and multiple caching backends

Go to Download

Filter Query Language

Go to Download

Hippo is an open-source tool that helps PHP programmers adhere to certain a given convention.

Go to Download

Travers - PHP array traversing via tokenized paths

Go to Download

Custom Bundle Extension (Custom Tokenizers) for Tonics Template System

Go to Download

PHP package for Byte Pair Encoding (BPE) used by GPT-3.

Go to Download

A tokenizer for PHP

Go to Download