Libraries tagged by tokenization
turanjanin/serbian-language-tools
2358 Downloads
Set of tools for tokenization, transliteration and diacritic restoration of a text written in Serbian language.
texhub/alif-pay
34 Downloads
Alif Acquiring (WebCheckout) payment gateway SDK for any PHP framework with first-class Laravel support: payments, tokenization, marketplace split-payments and webhooks.
angkor/khmercut
579 Downloads
Khmer Tokenization
tenqz/lingua
1 Downloads
A comprehensive PHP library for advanced text processing using Chain of Responsibility pattern
spiderwebtr/payment-kit
4 Downloads
Çok sağlayıcılı Laravel ödeme altyapısı + test panosu (3D Secure, kart saklama, taksit) — Horizon/Pulse tarzı.
ipagos/ipagos-php-sdk
29 Downloads
SDK profesional de alto nivel para la integración con iPagos en PHP, optimizado para PHP 8.2+.
hansajith18/laravel-paycorp
5 Downloads
Laravel integration for the Paycorp (Bancstac) payment gateway. Supports Hosted Page flow, Real-Time tokenised payments, and Refund/Void.
farzai/thai-word
45 Downloads
Thai word segmentation library for PHP
bizcommerce/erede-php
88 Downloads
e.Rede integration SDK
sastrawi/tokenizer
947 Downloads
PHP library that allows you to tokenize Bahasa Indonesia.
vojtech-dobes/php-grammar-processing
1092 Downloads
Library for tokenization, abstract syntax tree parsing & interpretation
nbgrp/singlea-tokenization-contracts
23 Downloads
The SingleA tokenization contracts
webrek/tokenizers
0 Downloads
Native byte-level BPE (tiktoken-compatible: cl100k_base/o200k_base) plus WordPiece and Unigram tokenizers for PHP 8.3+, with a process-shared vocab cache. Loads HuggingFace tokenizer.json models and counts Claude/Gemini tokens via their APIs.
highperapp/security
0 Downloads
Enterprise security management with comprehensive compliance frameworks (HIPAA, PCI-DSS, GDPR, CCPA+), payment tokenization, and advanced threat protection
helturkey/dujana-arabic-nlp
5 Downloads
A morphology-aware Arabic analysis package for PHP with Laravel support, providing normalization, tokenization, stemming, and root/pattern analysis.