Libraries tagged by tokenization

🧪 N-Gram Tools for 🙃 Phony Language Models with sanitizing, tokenization, n-gram extraction, frequency mapping

Go to Download

PHP Chain is a natural language processing library for PHP, inspired by the popular LangChain in Python. This library offers a modular and extensible approach to building NLP pipelines, allowing PHP developers to easily integrate natural language capabilities into their applications. PHP Chain supports a variety of NLP tasks, including but not limited to tokenization, semantic analysis, and text generation, providing a fluent interface and adaptable tool chains for different linguistic processing needs.

Go to Download

A PHP library for seamless interaction with Yandex GPT (Generative Pre-trained Transformer) API, providing text generation, tokenization, and embedding functionalities.

Go to Download

A Laravel package for integrating multiple payment gateways with PCI compliant tokenization

Go to Download

Mediasignature is a powerful and versatile package designed to provide image tokenization and access control capabilities. With Mediasignature, you can securely tokenize images and limit access to them for a specified period, adding an extra layer of protection to your valuable visual content

Go to Download

Fast tokenizers for PHP: BPE/WordPiece-style encode/decode, vocab loading, and batch tokenization for LLM and search pipelines.

Go to Download

Lexical search toolkit for PHP: tokenization, n-grams, BM25 scoring, and inverted-index helpers for hybrid RAG.

Go to Download

Client for using WorldPay stored profile tokenization endpoints.

Go to Download

Italian-first PII redaction pipeline for Laravel: deterministic regex + checksum-validated detectors (codice fiscale, P.IVA, IBAN), pluggable strategies (mask / hash / tokenise / drop), GDPR + EU AI Act ready.

Go to Download

Attribute-driven tokenisation for PHP.

Go to Download

Suscripciones y cobros recurrentes con Redsys para Laravel. Tokenizacion COF/MIT y firma HMAC SHA-512.

Go to Download

Unofficial PHP SDK for the PowerTranz payment gateway — 3DS, tokenisation, HPP, recurring billing

Go to Download

Laravel client for the MerchantSuite (Linkly) payments API v5: transactions, tokens, AuthKey checkout and webhooks.

Go to Download

Funciones de tokenizacion y escape de caracteres

Go to Download