Class Tokenizer

Simple lexical analyser.

Namespace: Nette\Utils
Located at Tokenizer/Tokenizer.php

Methods summary
`public`	# `__construct( array $patterns, string $flags = '' )` Parameters `$patterns` [(int\|string) token type => (string) pattern] `$flags` expression flags
`public array`	# `tokenize( string $input )` Tokenizes string. Tokenizes string. Parameters `$input` Returns `array` array Throws `Nette\Utils\TokenizerException` TokenizerException
`public static array`	# `getCoordinates( string $text, integer $offset )` Returns position of token in input string. Returns position of token in input string. Parameters `$text` `$offset` Returns `array` of [line, column]