Libraries tagged by tokenisation

A program for performing lexical analysis, written in PHP

Go to Download

Italian-first PII redaction pipeline for Laravel: deterministic regex + checksum-validated detectors (codice fiscale, P.IVA, IBAN), pluggable strategies (mask / hash / tokenise / drop), GDPR + EU AI Act ready.

Go to Download

Attribute-driven tokenisation for PHP.

Go to Download

A full text search engine with tokenization, stemming, typo tolerance, filters and geo support based on only PHP and SQLite

Go to Download

Authorize.Net CIM payment method for Magento 2.x by Paradox Labs

Go to Download

Base module for ParadoxLabs tokenization payment methods.

Go to Download

Go to Download

NLP Cloud serves high performance pre-trained or custom models for NER, sentiment-analysis, classification, summarization, paraphrasing, grammar and spelling correction, keywords and keyphrases extraction, chatbot, product description and ad generation, intent classification, text generation, image generation, code generation, question answering, automatic speech recognition, machine translation, language detection, semantic search, semantic similarity, tokenization, POS tagging, speech synthesis, embeddings, and dependency parsing. It is ready for production, served through a REST API. This is the PHP client for the API. More details here: https://nlpcloud.com. Documentation: https://docs.nlpcloud.com. Github: https://github.com/nlpcloud/nlpcloud-php

Go to Download

This is a PHP port of TinySegmenter, a JavaScript library for Japanese text segmentation.

Go to Download

Payment gateway service by SoftScholar

Go to Download

PHP Interface for Babel Street Text Analytics

Go to Download

CyberSource payment method for Magento 2.x by ParadoxLabs

Go to Download

Authorize.Net CIM payment method for Magento 2.x by Paradox Labs

Go to Download

Fast, pure-PHP tokenizer library compatible with Hugging Face tokenizers for encoding and decoding text

Go to Download

A PHP library for seamless interaction with Yandex GPT (Generative Pre-trained Transformer) API, providing text generation, tokenization, and embedding functionalities.

Go to Download