org.extex.scanner.api
Interface Tokenizer

All Known Subinterfaces:

Context, ContextInternals, Group, GroupExtension

All Known Implementing Classes:

ContextExtensionImpl, ContextImpl, GroupExtensionImpl, GroupImpl

public interface Tokenizer

A tokenizer is a class which is able to categorize characters according to the category codes.

Version:

$Revision:5563 $

Author:

Gerd Neugebauer

Method Summary

Catcode	getCatcode(UnicodeChar c) Getter for the category code of a character.
java.lang.String	getNamespace() Getter for the name space.

Method Detail

getCatcode

Catcode getCatcode(UnicodeChar c)

Getter for the category code of a character.

Parameters:

c - the Unicode character to analyze

Returns:

the category code of a character

getNamespace

java.lang.String getNamespace()

Getter for the name space.

Returns:

the name space