Variable tokenize

tokenize: (text: unknown) => Token[] = ...

Type Declaration

- (text: unknown): Token[]
- Splits ALFA source into tokens, ending with an end token.
  Parameters
  - text: unknown
    the source
  Returns Token[]
  the tokens, each with its kind, value and line
  
  Throws
  a syntax error on a character ALFA does not use