Libraries tagged by tokenized

A set of interfaces for the parser for the specificator

Go to Download

Rudl UDP cluster logging library (PSR4 compliant)

Go to Download

A polyfill for PHP 8.0's PhpToken class

Go to Download

Fast and extensible PHP code analysis and transformation

Go to Download

A PHP package to remove common stopwords from an input text, it covers most languages.

Go to Download

This project implements a simple lexer.

Go to Download

PHP version of tiktoken. PHP 7.4+ required.

Go to Download

PHP BPE Text Encoder/Decoder for GPT-2 / GPT-3. Based on coderevolutionplugins/gpt-3-encoder-php

Go to Download

Small utilities that assist in developing applications

Go to Download

A very lightweight PHP class that reformats unreadable and computer-generated SQL query statements to human-friendly, readable text.

Go to Download

Manipulation of php code, automated refactoring based on phps tokenizer

Go to Download

PHP_CodeSniffer tokenizes PHP, JavaScript and CSS files and detects violations of a defined set of coding standards.

Go to Download

Magento translation tool that utilizes PHP Tokenizer in order to generate csv files from PHP, XML, PHTML code

Go to Download

The HiPay Fullservice SDK for JavaScript allows you to tokenize credit or debit cards against the HiPay Fullservice payment platform.

Go to Download

PHP Library to tokenize various inputs.

Go to Download