• Revert "Stream: removed code that I don't know what is doing"

Deprecated Nette\Utils\Tokenizer & TokenIterator and added new Nette\Tokenizer\Tokenizer and Nette\Tokenizer\Stream that represents tokens as objects Nette\Tokenizer\Token instead of arrays.

• requires PHP 7.1
• uses PHP 7.1 features
• added PHP 7.1 scalar and return type hints
• added declare(strict_types=1);
• added Stream::consumeToken() & consumeValue() [Closes #17]

• requires PHP 5.4 and supports PHP up to 7.2
• added new classes Nette\Tokenizer\Tokenizer & Nette\Tokenizer\Stream
  • Tokenizer::tokenize return Stream instead of array
  • token is represented by object Token instead of array
  • removed support for 'simple' mode
• Nette\Utils\Tokenizer & Nette\Utils\TokenIterator are marked as deprecated (BC break)

• coding style: fixes, lowercase true/false/null
• @return self -> static

For the details you can have a look at the diff.

• improved coding style
• travis: migrating to container-based infrastructure

For the details you can have a look at the diff.

• improved coding style

For the details you can have a look at the diff.

The first standalone release. For more information see readme.md.