Libraries tagged by tokenzie
tsukasa/php-tokenizer
21077 Downloads
Polyfill for php extension Tokenizer
ride/lib-tokenizer
6653 Downloads
Tokenizer library of the Ride framework.
phootwork/tokenizer
206009 Downloads
Tokenizer for PHP code
muffin/tokenize
14471 Downloads
Security Tokens
ltd-beget/sphinx-configuration-tokenizer
16287 Downloads
tokenize sphinx configuration and that's all, folks.
infinityloop-dev/graphpinator-tokenizer
19558 Downloads
Tokenizer subproject for GraPHPinator: GraphQL server implementation for PHP.
artemeon/tokenizer
51158 Downloads
Tokenizer for php
simpletools/functionparser
4526 Downloads
Function parser for PHP functions, methods, and closures
hexydec/tokenise
5989 Downloads
A program for performing lexical analysis, written in PHP
guttedgarden/tiktoken
9638 Downloads
PHP 7.4 version of tiktoken
apicart/fql
9367 Downloads
Filter Query Language
udan11/sql-parser
907 Downloads
A validating SQL lexer and parser with a focus on MySQL dialect.
rahul900day/gpt-3-encoder
15965 Downloads
GPT-3-Encoder is a PHP implementation of OpenAI's original python encoder/decoder.
herrera-io/annotations
126858 Downloads
A tokenizer for Doctrine annotations.
mwstake/mediawiki-lib-nodes
10670 Downloads
Provides an infrastructure to tokenize content into nodes