Tokenizer
class Tokenizer
Simple lexical analyser.
Methods
__construct(array $patterns, $flags = '')
No description
static array
getCoordinates($text, $offset)
Returns position of token in input string.
Details
at line 27
__construct(array $patterns, $flags = '')
No description
at line 40
Stream
tokenize($input)
Tokenizes string.
at line 73
static array
getCoordinates($text, $offset)
Returns position of token in input string.