Download the PHP package semji/gpt-3-tokenizer-php without Composer
On this page you can find all versions of the php package semji/gpt-3-tokenizer-php. It is possible to download/install these versions without Composer. Possible dependencies are resolved automatically.
Table of contents
Download semji/gpt-3-tokenizer-php
More information about semji/gpt-3-tokenizer-php
Files in semji/gpt-3-tokenizer-php
Download semji/gpt-3-tokenizer-php
More information about semji/gpt-3-tokenizer-php
Files in semji/gpt-3-tokenizer-php
Vendor semji
Package gpt-3-tokenizer-php
Short Description PHP Text Tokenizer for GPT models
License MIT
Package gpt-3-tokenizer-php
Short Description PHP Text Tokenizer for GPT models
License MIT
Please rate this library. Is it a good library?
Informations about the package gpt-3-tokenizer-php
GPT3 tokenizer
PHP Text Tokenizer for GPT models
About
A PHP toolkit to tokenize text like GPT family of models process it.
Forked from https://github.com/CodeRevolutionPlugins/GPT-3-Encoder-PHP to fit our usage, fix bugs and add unit testing.
Usage
The mbstring PHP extension is needed for this tool to work correctly (in case non-ASCII characters are present in the tokenized text): details here on how to install mbstring PHP 8.1 is needed too;
All versions of gpt-3-tokenizer-php with dependencies
PHP Build Version
Package Version
Requires
php Version
^8.1
ext-mbstring Version *
ext-mbstring Version *
The package semji/gpt-3-tokenizer-php contains the following files
Loading the files please wait ....