Documentation / @andrew_l/search-query-language / Tokenizer
Class: Tokenizer ​
Extended by ​
Implements ​
Iterable<Token>
Constructors ​
Constructor ​
new Tokenizer(
input):Tokenizer
Parameters ​
input ​
string
Returns ​
Tokenizer
Methods ​
[iterator]() ​
[iterator]():
object
Returns ​
object
next() ​
next: () =>
object
Returns ​
object
done ​
done:
boolean
value ​
value:
Token=token
Implementation of ​
Iterable.[iterator]
getToken() ​
getToken():
Token
Get the next token.
Returns ​
Token