Libraries tagged by tokenzie

guttedgarden/tiktoken

4 Favers
13238 Downloads

PHP 7.4 version of tiktoken

Go to Download


rahul900day/gpt-3-encoder

2 Favers
29309 Downloads

GPT-3-Encoder is a PHP implementation of OpenAI's original python encoder/decoder.

Go to Download


strscan/strscan

13 Favers
132239 Downloads

Simple string tokenizer for lexical scanning operations

Go to Download


tsukasa/php-tokenizer

2 Favers
23001 Downloads

Polyfill for php extension Tokenizer

Go to Download


phootwork/tokenizer

2 Favers
209000 Downloads

Tokenizer for PHP code

Go to Download


mathematicator-core/tokenizer

10 Favers
4663 Downloads

Math Tokenizer

Go to Download


ltd-beget/sphinx-configuration-tokenizer

3 Favers
20510 Downloads

tokenize sphinx configuration and that's all, folks.

Go to Download


fi1a/tokenizer

0 Favers
6320 Downloads

Лексический анализатор строк (tokenizer). Разбор входной последовательности символов на распознанные группы (лексемы).

Go to Download


artemeon/tokenizer

0 Favers
71125 Downloads

Tokenizer for php

Go to Download


kevintweber/html-tokenizer

5 Favers
47572 Downloads

Will tokenize HTML.

Go to Download


h4kuna/latte-php-tokenizer

0 Favers
17527 Downloads

Transform macro args to array.

Go to Download


simpletools/functionparser

0 Favers
19215 Downloads

Function parser for PHP functions, methods, and closures

Go to Download


phplrt/lexer-contracts

1 Favers
144951 Downloads

A set of phplrt lexer abstractions

Go to Download


hexydec/tokenise

3 Favers
8719 Downloads

A program for performing lexical analysis, written in PHP

Go to Download


camspiers/statistical-classifier

176 Favers
36990 Downloads

A PHP implementation of Complement Naive Bayes and SVM statistical classifiers, including a structure for building other classifier, multiple data sources and multiple caching backends

Go to Download


<< Previous Next >>