Libraries tagged by tokenized

dhii/xml-tokenizer-interface

0 Favers
8 Downloads

An interface for XML tokenizers

dhii/tokenizer-interface

0 Favers
166 Downloads

Interfaces for tokenizer interoperability.

dhii/tokenizer-base

0 Favers
8 Downloads

Base concrete functionality for tokenizers

dhii/tokenizer-abstract

0 Favers
44 Downloads

Abstract common functionality for tokenizers.

dennislindsey/tokenize

0 Favers
24 Downloads

Tokenization Interface

crazzy501/gpt3-tokenizer

0 Favers
8 Downloads

PHP package for Byte Pair Encoding (BPE) used by GPT-3.

componenta/tokenizer

0 Favers
12 Downloads

Token-based PHP source inspection helpers for Componenta

chinleung/tokenizer

0 Favers
591 Downloads

PHP Tokenizer

brunocfalcao/laravel-tokenizer

0 Favers
97 Downloads

Laravel tokenizer - Token usage for web apps (create, burn, check, etc)

averay/tokenised-strings

0 Favers
273 Downloads

A lightweight system for rendering tokens in templated strings.

athron98/ihas-tokenizer

0 Favers
4 Downloads

iHAS API Token Generator

atefeboluri/laravel-tokenize-login

0 Favers
10 Downloads

amsterdamstandard/tokenizer

1 Favers
17 Downloads

Tokenizer api wrapper for PHP

affinity4/tokenizer

0 Favers
7 Downloads

A zero-dedpendency tokenizer written in PHP. Returns an easily navigatable Stream object of Token objects with public type, value, offset and length properties

ae8/tokenizer

2 Favers
16 Downloads

A simple PHP library for token-based encryption.

<< Previous Next >>