Libraries tagged by tokenize

Library to tokenize, edit and override PHP classes

Go to Download

A tokenizer-agnostic text preprocessor to trim context for LLMs.

Go to Download

PHP_CodeSniffer tokenizes PHP, JavaScript and CSS files and detects violations of a defined set of coding standards.

Go to Download

bKash Tokenized Payment Gateway Implementation for Laravel

Go to Download

This package or Library for Bkash, developed by abdursoft. This library come with MIT license, so you can easily change anything what ever your needs.This package will work for bkash tokenized payment system. If they are updated their version and the library couldn't work properly, please contact with [email protected]

Go to Download

Tokenize User Authentication backports.

Go to Download

A full text search engine with tokenization, stemming, typo tolerance, filters and geo support based on only PHP and SQLite

Go to Download

a clone of python tiktoken but for PHP! fast BPE tokeniser for use with OpenAI's models.

Go to Download

Authorize.Net CIM payment method for Magento 2.x by Paradox Labs

Go to Download

Base module for ParadoxLabs tokenization payment methods.

Go to Download

Go to Download

NLP Cloud serves high performance pre-trained or custom models for NER, sentiment-analysis, classification, summarization, paraphrasing, grammar and spelling correction, keywords and keyphrases extraction, chatbot, product description and ad generation, intent classification, text generation, image generation, code generation, question answering, automatic speech recognition, machine translation, language detection, semantic search, semantic similarity, tokenization, POS tagging, speech synthesis, embeddings, and dependency parsing. It is ready for production, served through a REST API. This is the PHP client for the API. More details here: https://nlpcloud.com. Documentation: https://docs.nlpcloud.com. Github: https://github.com/nlpcloud/nlpcloud-php

Go to Download

(fork) PHP_CodeSniffer tokenises PHP, JavaScript and CSS files and detects violations of a defined set of coding standards.

Go to Download

PHP_CodeSniffer tokenises PHP, JavaScript and CSS files and detects violations of a defined set of coding standards. Hostnet version

Go to Download

This is a PHP port of TinySegmenter, a JavaScript library for Japanese text segmentation.

Go to Download