Libraries tagged by tokenized
rajentrivedi/tokenizer-x
284982 Downloads
TokenizerX calculates required tokens for given prompt
imanghafoori/laravel-tokenize-login
276267 Downloads
Helps you generate and send a random token to have passwordless login.
gioni06/gpt3-tokenizer
669161 Downloads
PHP package for Byte Pair Encoding (BPE) used by GPT-3.
nilportugues/sql-query-formatter
1261887 Downloads
A very lightweight PHP class that reformats unreadable and computer-generated SQL query statements to human-friendly, readable text.
loupe/matcher
286917 Downloads
Tokenize, decompose, highlight and crop around text and search terms
udan11/sql-parser
8348 Downloads
A validating SQL lexer and parser with a focus on MySQL dialect.
fig-r/psr2r-sniffer
1415973 Downloads
Code-Sniffer, Auto-Fixer and Tokenizer for PSR2-R
karim007/laravel-bkash-tokenize
36721 Downloads
This is bKash tokenize payment gateway for laravel
nicoswd/php-rule-parser
84296 Downloads
Rule Engine - Rule Parser & Evaluator
jeremeamia/functionparser
178917 Downloads
Function parser for PHP functions, methods, and closures
danny50610/bpe-tokeniser
502064 Downloads
PHP port for openai/tiktoken (most)
coderevolutionplugins/gpt-3-encoder-php
52596 Downloads
PHP BPE Text Encoder/Decoder for GPT-2 / GPT-3
strscan/strscan
180743 Downloads
Simple string tokenizer for lexical scanning operations
ze/tokenizer-gpt3
41088 Downloads
PHP package for Byte Pair Encoding (BPE) used by GPT-3.
nette/tokenizer
Downloads