Libraries tagged by tokenized

Bkash Payment Integration for Laravel.

Go to Download

A Naive Bayesian classification library for PHP with support for different tokenizers to optimize string classification.

Go to Download

Flexible, strategy-based text chunking for Laravel with support for character, token, sentence, and markdown-aware splitting. Perfect for AI/LLM applications and RAG systems.

Go to Download

A simple library for make Lexer and Parsers to build a language

Go to Download

PHP BPE Text Encoder/Decoder for GPT-2 / GPT-3. Based on coderevolutionplugins/gpt-3-encoder-php

Go to Download

A PHP implementation of Complement Naive Bayes and SVM statistical classifiers, including a structure for building other classifier, multiple data sources and multiple caching backends

Go to Download

Tokenizer of YAML

Go to Download

Hippo is an open-source tool that helps PHP programmers adhere to certain a given convention.

Go to Download

Custom Bundle Extension (Custom Tokenizers) for Tonics Template System

Go to Download

Modernized, composer compatible version of Tim Whitlock's JTokenizer PHP Javascript parser and tokenizer library.

Go to Download

Polyfill for php extension Tokenizer

Go to Download

A tokenizer for PHP

Go to Download

With Tokenizer you can easily convert a string to a stream or array of tokens.

Go to Download

configurable string tokenizer

Go to Download

Wrapper around token_get_all. Easy to extract and modify php code.

Go to Download