Class Tokenizer

Simple lexical analyser.

Namespace: Nette\Utils
Located at Tokenizer/Tokenizer.php

Methods summary
`public`	# `__construct( array $patterns, string $flags = '' )` Parameters `$patterns` `array` of [(int\|string) token type => (string) pattern] `$flags` `string` regular expression flags
`public array`	# `tokenize( string $input )` Tokenizes string. Tokenizes string. Parameters `$input` `string` Returns `array` Throws `Nette\Utils\TokenizerException`
`public static array`	# `getCoordinates( string $text, integer $offset )` Returns position of token in input string. Returns position of token in input string. Parameters `$text` `string` `$offset` `integer` Returns `array` of [line, column]