Libraries tagged by tokenized

PHP BPE Text Encoder/Decoder for GPT-2 / GPT-3. Based on coderevolutionplugins/gpt-3-encoder-php

Go to Download

Turn everything into a token: randomized or predictable.

Go to Download

Serialize Closure objects, including their context and binding

Go to Download

Doing interesting things with closures like serialization.

Go to Download

Go to Download

PHP_CodeSniffer tokenizes PHP, JavaScript and CSS files and detects violations of a defined set of coding standards.

Go to Download

Implements Iterator interface over a String for extract data with an array of tokens. The name comes from Mage and tokenizer :)

Go to Download

PHP_CodeSniffer tokenizes PHP, JavaScript and CSS files and detects violations of a defined set of coding standards.

Go to Download

Command-line script to convert PHP's array() syntax to PHP 5.4's short array syntax [] using PHP's built-in tokenizer.

Go to Download

PHP_CodeSniffer tokenizes PHP, JavaScript and CSS files and detects violations of a defined set of coding standards.

Go to Download

Tokenizer and composer for search query from user input.

Go to Download

Command-line script to convert or revert PHP's array() syntax to PHP 5.4's short array syntax [] using PHP's built-in tokenizer.

Go to Download

The SingleA tokenizer JWT implementation

Go to Download

PHP_CodeSniffer tokenizes PHP, JavaScript and CSS files and detects violations of a defined set of coding standards.

Go to Download

PHP_CodeSniffer tokenizes PHP, JavaScript and CSS files and detects violations of a defined set of coding standards.

Go to Download