Package org.antlr.v4.runtime

Interface TokenFactory

All Known Implementing Classes:

CommonTokenFactory

public interface TokenFactory

The default mechanism for creating tokens. It's used by default in Lexer and the error handling strategy (to create missing tokens). Notifying the parser of a new factory means that it notifies its token source and error strategy.

Method Summary

Modifier and Type	Method	Description
Token	create(int type, String text)	Generically useful
Token	create(Tuple2<? extends TokenSource,CharStream> source, int type, String text, int channel, int start, int stop, int line, int charPositionInLine)	This is the method used to create tokens in the lexer and in the error handling strategy.

Method Details

create

@NotNull
Token create(@NotNull
 Tuple2<? extends TokenSource,CharStream> source,
 int type,
 String text,
 int channel,
 int start,
 int stop,
 int line,
 int charPositionInLine)

This is the method used to create tokens in the lexer and in the error handling strategy. If text!=null, than the start and stop positions are wiped to -1 in the text override is set in the CommonToken.

create

@NotNull
Token create(int type,
 String text)

Generically useful