Libraries tagged by tokeniser

kerasai/behat-tokenizer

0 Favers
20413 Downloads

Token replacement for Behat test suite.

Go to Download


aisk/mistral-tokenizer

1 Favers
119 Downloads

PHP implementation of Mistral's tokenizers

Go to Download


turanjanin/serbian-language-tools

17 Favers
2053 Downloads

Set of tools for tokenization, transliteration and diacritic restoration of a text written in Serbian language.

Go to Download


tacoberu/bnf

5 Favers
2756 Downloads

Framework for building BNF like parsers.

Go to Download


popsul/php-token-reflection

3 Favers
77501 Downloads

Library emulating the PHP internal reflection using just the tokenized source code.

Go to Download


hybridlogic/classifier

80 Favers
1445 Downloads

A Naive Bayesian classification library for PHP with support for different tokenizers to optimize string classification.

Go to Download


camspiers/statistical-classifier

176 Favers
36991 Downloads

A PHP implementation of Complement Naive Bayes and SVM statistical classifiers, including a structure for building other classifier, multiple data sources and multiple caching backends

Go to Download


apicart/fql

12 Favers
10124 Downloads

Filter Query Language

Go to Download


hippophp/hippo

80 Favers
32 Downloads

Hippo is an open-source tool that helps PHP programmers adhere to certain a given convention.

Go to Download


devsrealm/tonics-template-system-extension-bundle

0 Favers
636 Downloads

Custom Bundle Extension (Custom Tokenizers) for Tonics Template System

Go to Download


textualization/ropherta-tokenizer

1 Favers
91 Downloads

GPT3Tokenizer (BPE) with Roberta-base vocabulary.

Go to Download


tanuel/tokenizer

6 Favers
15 Downloads

A tokenizer for PHP

Go to Download


mathematicator-core/tokenizer

10 Favers
4665 Downloads

Math Tokenizer

Go to Download


interitty/tokenizer

2 Favers
52 Downloads

Use regular expressions to split a given string into tokens.

Go to Download


gollumsf/url-tokenizer-bundle

1 Favers
1701 Downloads

Simple url tokenizer

Go to Download


<< Previous Next >>