Tokenizer for PHP code.
Install via Composer:
composer require phootwork/tokenizer
This package is a part of the Phootwork library. In order to run the test suite, you have to download the full library.
git clone https://github.com/phootwork/phootwork
Then install the dependencies via composer:
composer install
Now, run the tokenizer test suite:
vendor/bin/phpunit --testsuite tokenizer
If you want to run the whole library tests, simply run:
vendor/bin/phpunit
Report issues at the github Issue Tracker.
Refer to Releases