Libraries tagged by tokenization

Set of tools for tokenization, transliteration and diacritic restoration of a text written in Serbian language.

Go to Download

Alif Acquiring (WebCheckout) payment gateway SDK for any PHP framework with first-class Laravel support: payments, tokenization, marketplace split-payments and webhooks.

Go to Download

Khmer Tokenization

Go to Download

A comprehensive PHP library for advanced text processing using Chain of Responsibility pattern

Go to Download

Çok sağlayıcılı Laravel ödeme altyapısı + test panosu (3D Secure, kart saklama, taksit) — Horizon/Pulse tarzı.

Go to Download

SDK profesional de alto nivel para la integración con iPagos en PHP, optimizado para PHP 8.2+.

Go to Download

Laravel integration for the Paycorp (Bancstac) payment gateway. Supports Hosted Page flow, Real-Time tokenised payments, and Refund/Void.

Go to Download

Thai word segmentation library for PHP

Go to Download

e.Rede integration SDK

Go to Download

PHP library that allows you to tokenize Bahasa Indonesia.

Go to Download

Library for tokenization, abstract syntax tree parsing & interpretation

Go to Download

The SingleA tokenization contracts

Go to Download

Native byte-level BPE (tiktoken-compatible: cl100k_base/o200k_base) plus WordPiece and Unigram tokenizers for PHP 8.3+, with a process-shared vocab cache. Loads HuggingFace tokenizer.json models and counts Claude/Gemini tokens via their APIs.

Go to Download

Enterprise security management with comprehensive compliance frameworks (HIPAA, PCI-DSS, GDPR, CCPA+), payment tokenization, and advanced threat protection

Go to Download

A morphology-aware Arabic analysis package for PHP with Laravel support, providing normalization, tokenization, stemming, and root/pattern analysis.

Go to Download