Libraries tagged by tokenisation
hexydec/tokenise
11823 Downloads
A program for performing lexical analysis, written in PHP
ryangjchandler/lexical
372 Downloads
Attribute-driven tokenisation for PHP.
padosoft/laravel-pii-redactor
0 Downloads
Italian-first PII redaction pipeline for Laravel: deterministic regex + checksum-validated detectors (codice fiscale, P.IVA, IBAN), pluggable strategies (mask / hash / tokenise / drop), GDPR + EU AI Act ready.
loupe/loupe
232988 Downloads
A full text search engine with tokenization, stemming, typo tolerance, filters and geo support based on only PHP and SQLite
paradoxlabs/authnetcim
172169 Downloads
Authorize.Net CIM payment method for Magento 2.x by Paradox Labs
paradoxlabs/tokenbase
198826 Downloads
Base module for ParadoxLabs tokenization payment methods.
nbgrp/singlea-tokenization-implementation
Downloads
nlpcloud/nlpcloud-client
25618 Downloads
NLP Cloud serves high performance pre-trained or custom models for NER, sentiment-analysis, classification, summarization, paraphrasing, grammar and spelling correction, keywords and keyphrases extraction, chatbot, product description and ad generation, intent classification, text generation, image generation, code generation, question answering, automatic speech recognition, machine translation, language detection, semantic search, semantic similarity, tokenization, POS tagging, speech synthesis, embeddings, and dependency parsing. It is ready for production, served through a REST API. This is the PHP client for the API. More details here: https://nlpcloud.com. Documentation: https://docs.nlpcloud.com. Github: https://github.com/nlpcloud/nlpcloud-php
u7aro/tinysegmenter-php
5732 Downloads
This is a PHP port of TinySegmenter, a JavaScript library for Japanese text segmentation.
rosette/api
22931 Downloads
PHP Interface for Babel Street Text Analytics
paradoxlabs/cybersource
19587 Downloads
CyberSource payment method for Magento 2.x by ParadoxLabs
paradoxlabs/authnetcim-hyva-checkout
18029 Downloads
Authorize.Net CIM payment method for Magento 2.x by Paradox Labs
teariot/php-yandex-gpt
3450 Downloads
A PHP library for seamless interaction with Yandex GPT (Generative Pre-trained Transformer) API, providing text generation, tokenization, and embedding functionalities.
softscholar/laravel-payments
881 Downloads
Payment gateway service by SoftScholar
codewithkyrian/tokenizers
25 Downloads
Fast, pure-PHP tokenizer library compatible with Hugging Face tokenizers for encoding and decoding text