Documentation / @andrew_l/search-query-language / Tokenizer

Class: Tokenizer

Extended by

• Expression

Implements

• Iterable<Token>

Constructors

Constructor

new Tokenizer(input): Tokenizer

Parameters

input

string

Returns

Tokenizer

Methods

[iterator]()

[iterator](): object

Returns

object

next()

next: () => object

Returns

object

done

done: boolean

value

value: Token = token

Implementation of

Iterable.[iterator]

---

getToken()

getToken(): Token

Get the next token.

Returns

Token