Libraries tagged by tokenize

Command-line script to convert or revert PHP's array() syntax to PHP 5.4's short array syntax [] using PHP's built-in tokenizer.

Go to Download

The SingleA tokenizer JWT implementation

Go to Download

Lists the PHP files that depend on the files you specify. Static analysis with PHP's own tokenizer only - no coverage run, no framework lock-in, no runtime dependencies.

Go to Download

bKash PGW (Tokenized Checkout) integration for Laravel: payments, refunds, agreements, payouts, webhooks

Go to Download

PHP_CodeSniffer tokenizes PHP, JavaScript and CSS files and detects violations of a defined set of coding standards.

Go to Download

PHP_CodeSniffer tokenizes PHP, JavaScript and CSS files and detects violations of a defined set of coding standards.

Go to Download

Laravel 11+ package for BKash checkout, tokenized checkout, B2C, B2B payout, refund, search, and wallet operations.

Go to Download

WaitingFor based tokenizer

Go to Download

PHP_CodeSniffer tokenizes PHP, JavaScript and CSS files and detects violations of a defined set of coding standards.

Go to Download

Mediasignature is a powerful and versatile package designed to provide image tokenization and access control capabilities. With Mediasignature, you can securely tokenize images and limit access to them for a specified period, adding an extra layer of protection to your valuable visual content

Go to Download

Make a tokenize for our API in Laravel is never been easy

Go to Download

A forgiving code tokenizer for tokenizing most programming languages such as Javascript, TypeScript, Python, C, C++, PHP, Forth and so on. A nice basis for making a compiler or DSL.

Go to Download

Fast tokenizers for PHP: BPE/WordPiece-style encode/decode, vocab loading, and batch tokenization for LLM and search pipelines.

Go to Download

Library to tokenize, edit and override PHP classes

Go to Download

A tokenizer-agnostic text preprocessor to trim context for LLMs.

Go to Download