Class Tokenizer


  • public class Tokenizer
    extends Object
    This class converts a template string (stream of characters) into a stream of tokens. The result of the tokenization (also called lexical analysis) serves as input for the parser TemplateParser.