Class Tokenizer

Simple lexical analyser.

Namespace: Nette\Tokenizer
Located at Tokenizer/Tokenizer.php

Methods summary
`public`	# `__construct( array $patterns, string $flags = '' )` Parameters `$patterns` [(int\|string) token type => (string) pattern] `$flags` expression flags
`public Nette\Tokenizer\Stream`	# `tokenize( string $input )` Tokenizes string. Tokenizes string. Parameters `$input` Returns `Nette\Tokenizer\Stream` Stream Throws `Nette\Tokenizer\Exception` Exception
`public static array`	# `getCoordinates( string $text, integer $offset )` Returns position of token in input string. Returns position of token in input string. Parameters `$text` `$offset` Returns `array` of [line, column]