Download the PHP package hexydec/tokenise without Composer
On this page you can find all versions of the php package hexydec/tokenise. It is possible to download/install these versions without Composer. Possible dependencies are resolved automatically.
Download hexydec/tokenise
More information about hexydec/tokenise
Files in hexydec/tokenise
Package tokenise
Short Description A program for performing lexical analysis, written in PHP
License MIT
Homepage https://github.com/hexydec/tokenise
Informations about the package tokenise
Tokenise: A Regexp Based PHP Tokeniser
A program for performing lexical analysis, written in PHP. Designed to supply tokens to a parser in order to analyse the syntax of programming languages.
Description
Using an array of regular expressions, tokens are extracted from the input code in sequence and upon request. Previous tokens can also be re-requested, and custom regular expressions can also be used to retrieve the next token.
Currently used in my other projects:
- HTMLdoc: PHP HTML Document Parser and Minifier
- CSSdoc: PHP CSS Document Parser and Minifier
- JSlite: PHP Javascript Minifier
Usage
Basic usage within a program:
API
For more detailed usage documentation, read the API document.
Support
Tokenise supports PHP version 8.1+.
Contributing
If you find an issue with tokenise, please create an issue in the tracker.
If you wish to fix an issue yourself, please fork the code, fix the issue, then create a pull request, and I will evaluate your submission.
Licence
The MIT License (MIT). Please see License File for more information.