Package org.extex.scanner.api

This package contains the scanner for ExTeX.

See:
          Description

Interface Summary
Tokenizer A tokenizer is a class which is able to categorize characters according to the category codes.
TokenStream This interface describes the features of a stream capable of delivering Tokens.
 

Package org.extex.scanner.api Description

This package contains the scanner for ExTeX. Its main purpose is to extract tokens from an input stream. The input stream can one of several sources: a token buffer, a string, a file or an arbitrary Reader.