Uses of Interface
org.extex.scanner.type.token.Token

Packages that use Token

org.extex.base.parser	This package contains parsers for ExTeX.
org.extex.interpreter	This package contains the macro expansion engine and all supporting classes.
org.extex.interpreter.context	This package contains the container for data in the interpreter.
org.extex.interpreter.context.group	This package contains some support classes for groups.
org.extex.interpreter.context.observer.code	This package contains definitions for a code change observer.
org.extex.interpreter.max	This package contains the macro expansion engine and supporting classes.
org.extex.interpreter.max.context	This package contains a reference implementation for the Context.
org.extex.interpreter.observer.command	This package contains definitions for the execute observer.
org.extex.interpreter.observer.expand	This package contains definitions for the expand observer.
org.extex.interpreter.observer.expandMacro	This package contains definitions for the expand macro observer.
org.extex.interpreter.observer.pop	This package contains definitions for the pop observer.
org.extex.interpreter.observer.push	This package contains definitions for the push observer.
org.extex.interpreter.type	This package contains the basic data types for ExTeX.
org.extex.interpreter.type.box	This package contains the basic box data types for ExTeX.
org.extex.main.tex	This package contains some support classes for the ExTeX main program.
org.extex.scanner.api	This package contains the scanner for ExTeX.
org.extex.scanner.base	This package contains a basic implementation for a TokenStream.
org.extex.scanner.stream.impl32	This package contains the implementations for different TokenStream implementations.
org.extex.scanner.type.token	This package contains the token types for the scanner of ExTeX.
org.extex.scanner.type.tokens	This package contains the basic tokens data types for ExTeX.
org.extex.typesetter.impl	This package contains an implmentation of a typesetter and its associated classes.
org.extex.typesetter.listMaker	This package contains implementations for list makers of several kind.
org.extex.typesetter.listMaker.math	This package contains implementations for math list makers.
org.extex.unit.base.macro	This package contains macro primitives for the ExTeX engine.
org.extex.unit.base.register.font	This package contains primitives for the manipulation of font registers.
org.extex.unit.tex	This package contains classes for the primitives which are mapped to Java code.
org.extex.unit.tex.hyphen	This package contains the primitives for hyphenations in ExTeX.
org.extex.unit.tex.info	This package contains primitives for debugging.
org.extex.unit.tex.macro	This package contains primitives for the management of macros.
org.extex.unit.tex.macro.util	This package contains utilities for the management of macros.
org.extex.unit.tex.register.box	This package contains primitives for the manipulation of box registers.
org.extex.unit.tex.table	This package contains primitives for the typesetting of tables.
org.extex.unit.tex.table.util	This package contains utility classes for the processing of alignment tables.
org.extex.unit.tex.typesetter.box	This package contains primitives which deal with boxes and rules.
org.extex.unit.tex.typesetter.displace	This package contains primitives which shifting and moving nodes.
org.extex.unit.tex.typesetter.undo	This package contains primitives which deal with decomposing boxes.

Uses of Token in org.extex.base.parser

Methods in org.extex.base.parser with parameters of type Token

static long	ScaledNumberParser.scanFloat(Context context, TokenSource source, Typesetter typesetter, Token start) Parses a token stream for a float and returns it as fixed point number.
static long	ConstantCountParser.scanNumber(Context context, TokenSource source, Typesetter typesetter, Token token) Scan the input stream for tokens making up a number, this is a sequence of digits with category code OTHER.

Uses of Token in org.extex.interpreter

Methods in org.extex.interpreter that return Token

Token	TokenSource.expand(Token token, Context context, Typesetter typesetter) Try to expand a single token and return the result.
Token	TokenSource.getLastToken() Getter for the token just previously read from the token source.
Token	TokenSource.getNonSpace(Context context) Get the next token which has not the category code SPACE.
Token	TokenSource.getToken(Context context) Get the next token form the input streams.
Token	TokenSource.scanNonSpace(Context context) Scan the input for the next token which has not the category code SPACE.
Token	TokenSource.scanToken(Context context) Get the next expanded token form the input streams.

Methods in org.extex.interpreter with parameters of type Token

void	TokenSource.execute(Token token, Context context, Typesetter typesetter) Tries to execute a token.
Token	TokenSource.expand(Token token, Context context, Typesetter typesetter) Try to expand a single token and return the result.
Box	TokenSource.getBox(Flags flags, Context context, Typesetter typesetter, Token insert) Parse the specification of a box.
boolean	ErrorHandler.handleError(GeneralException e, Token token, TokenSource source, Context context) This is the error handling callback.
void	TokenSource.push(Token token) Push back a token onto the input stream for subsequent reading.
void	TokenSource.push(Token[] tokens) Push back a list of tokens onto the input stream for subsequent reading.

Uses of Token in org.extex.interpreter.context

Methods in org.extex.interpreter.context that return Token

Token

Context.getAfterassignment() Getter for the afterassignment token.

Methods in org.extex.interpreter.context with parameters of type Token

void	ContextGroup.afterGroup(Token t) Add a token to the tokens inserted after the group has been closed.
java.lang.String	Context.esc(Token token) This method is meant to produce a printable version of a control sequence for error messages.
void	ContextGroup.openGroup(GroupType id, Locator locator, Token start) This method can be used to open another group.
void	Context.setAfterassignment(Token token) Setter for the afterassignment token.

Uses of Token in org.extex.interpreter.context.group

Methods in org.extex.interpreter.context.group that return Token

Token

GroupInfo.getGroupStart() Getter for the starting token of the group.

Uses of Token in org.extex.interpreter.context.observer.code

Methods in org.extex.interpreter.context.observer.code with parameters of type Token

void	CodeObserver.receiveCodeChange(ContextInternals context, Token name, Code value) Receive a notification on a code change.
void	CodeObservable.registerCodeChangeObserver(Token token, CodeObserver observer) Register an observer for code change events.
void	CodeObservable.unregisterCodeChangeObserver(Token name, CodeObserver observer) Remove a registered observer for code change events.

Uses of Token in org.extex.interpreter.max

Methods in org.extex.interpreter.max that return Token

protected Token	Max.expand(Token token) Take the token given and expand it as possible.
Token	Max.expand(Token token, Context context, Typesetter typesetter) Try to expand a single token and return the result.
protected Token	Max.expandUnproteced(Token token, Tokens tokens) Take the token given and expand it as possible while honoring the protected code.
Token	Moritz.getLastToken()
Token	Moritz.getNonSpace(Context context) Get the next token which has not the category code SPACE.
Token	Moritz.getToken(Context context) Get the next token from the input streams.
Token	Moritz.scanNonSpace(Context context) Scan the input for the next token which has not the category code SPACE.
Token	Moritz.scanToken(Context context) Get the next expanded token form the input streams.

Methods in org.extex.interpreter.max with parameters of type Token

void	Max.execute(Token token, Context theContext, Typesetter theTypesetter)
protected Token	Max.expand(Token token) Take the token given and expand it as possible.
Token	Max.expand(Token token, Context context, Typesetter typesetter) Try to expand a single token and return the result.
protected Token	Max.expandUnproteced(Token token, Tokens tokens) Take the token given and expand it as possible while honoring the protected code.
Box	Moritz.getBox(Flags flags, Context context, Typesetter typesetter, Token insert) Parse the specification of a box.
long	Moritz.getNumber(Token token) Scan a number with a given first token.
void	Moritz.push(Token token) Push back a token onto the input stream for subsequent reading.
void	Moritz.push(Token[] tokens) Push back a list of tokens onto the input stream for subsequent reading.

Uses of Token in org.extex.interpreter.max.context

Methods in org.extex.interpreter.max.context that return Token

Token	ContextImpl.getAfterassignment() Getter for the after assignment token.
Token	GroupInfoImpl.getGroupStart() Getter for the starting token of the group.
Token	GroupImpl.getStart() Getter for the token which started the group.
Token	Group.getStart() Getter for the token which started the group.

Methods in org.extex.interpreter.max.context with parameters of type Token

void	GroupImpl.afterGroup(Token t) Add the token to the tokens to be inserted after the group is closed.
void	Group.afterGroup(Token t) Add the token to the tokens to be inserted after the group is closed.
void	ContextImpl.afterGroup(Token t) Add a token to the tokens inserted after the group has been closed.
java.lang.String	ContextImpl.esc(Token token) This method is meant to produce a printable version of a control sequence for error messages.
Group	GroupFactory.newInstance(Group next, Locator locator, Token start, GroupType type) Get a instance of a Group.
void	ContextImpl.openGroup(GroupType type, Locator locator, Token start) This method can be used to open another group.
void	ContextImpl.registerCodeChangeObserver(Token token, CodeObserver observer) Register an observer for code change events.
void	ContextImpl.setAfterassignment(Token token) Setter for the after assignment token.
void	GroupImpl.setCode(Token token, Code code, boolean global) Setter for active characters or macros in the requested group.
void	Group.setCode(Token token, Code code, boolean global) Setter for active characters or macros in the requested group.
void	GroupInfoImpl.setGroupStart(Token groupStart) Setter for groupStart.
void	GroupImpl.setStart(Token start) Setter for start token.
void	Group.setStart(Token start) Setter for the start token.
void	ContextImpl.unregisterCodeChangeObserver(Token name, CodeObserver observer) Remove a registered observer for code change events.

Constructors in org.extex.interpreter.max.context with parameters of type Token

GroupInfoImpl(Locator locator, GroupType groupType, Token groupStart)
Creates a new object.

Uses of Token in org.extex.interpreter.observer.command

Methods in org.extex.interpreter.observer.command with parameters of type Token

void	CommandObserver.update(Token token) This method is meant to be invoked just before a token is expanded.
void	CommandObserverList.update(Token token) Invoke all observers on the list to inform them of the token to be expanded.

Uses of Token in org.extex.interpreter.observer.expand

Methods in org.extex.interpreter.observer.expand with parameters of type Token

void	ExpandObserver.update(Token token) This method is meant to be invoked just before a token is expanded.
void	ExpandObserverList.update(Token token) Invoke all observers on the list to inform them of the token to be expanded.

Uses of Token in org.extex.interpreter.observer.expandMacro

Methods in org.extex.interpreter.observer.expandMacro with parameters of type Token

void	ExpandMacroObserver.update(Token token, Code code, Locator locator) This method is meant to be invoked just before a macro is expanded.
void	ExpandMacroObserverList.update(Token token, Code code, Locator locator) This method is meant to be invoked just before a macro is expanded.

Uses of Token in org.extex.interpreter.observer.pop

Methods in org.extex.interpreter.observer.pop with parameters of type Token

void	PopObserver.update(Token token) This method is meant to be invoked just after a pop ocurrs.
void	PopObserverList.update(Token token) Invoke all observers on the list to inform them of the token to be poped.

Uses of Token in org.extex.interpreter.observer.push

Methods in org.extex.interpreter.observer.push with parameters of type Token

void	PushObserver.update(Token token) This method is meant to be invoked just after a push event.
void	PushObserverList.update(Token token) Invoke all observers on the list to inform them of the token to be pushed.

Uses of Token in org.extex.interpreter.type

Methods in org.extex.interpreter.type that return Token

Token

CsConvertible.convertCs(Context context, TokenSource source, Typesetter typesetter) This method converts into control sequence.

Methods in org.extex.interpreter.type with parameters of type Token

boolean

ComparableCode.compare(Token token, Context context) Compare the code with some other code.

Uses of Token in org.extex.interpreter.type.box

Methods in org.extex.interpreter.type.box with parameters of type Token

Box	Boxable.getBox(Context context, TokenSource source, Typesetter typesetter, Token insert) Getter for the content as Box.

Constructors in org.extex.interpreter.type.box with parameters of type Token

Box(Context context, TokenSource source, Typesetter typesetter, boolean isHorizontal, Tokens insert, GroupType groupType, Token startToken)
Creates a new object.

Uses of Token in org.extex.main.tex

Methods in org.extex.main.tex with parameters of type Token

boolean	ErrorHandlerImpl.handleError(GeneralException exception, Token t, TokenSource source, Context context) This is the error handling callback.
void	TokenPushObserver.update(Token token) This method is meant to be invoked just after a push event.
void	TokenObserver.update(Token token) This method is meant to be invoked just after a pop ocurrs.

Uses of Token in org.extex.scanner.api

Methods in org.extex.scanner.api that return Token

Token

TokenStream.get(TokenFactory factory, Tokenizer tokenizer) Get the next token from the token stream.

Methods in org.extex.scanner.api with parameters of type Token

void	TokenStream.put(Token token) Push back a token into the stream.

Uses of Token in org.extex.scanner.base

Methods in org.extex.scanner.base that return Token

Token	TokenStreamBaseImpl.get(TokenFactory factory, Tokenizer tokenizer) Get the next token from the token stream.
protected Token	TokenStreamImpl.getNext(TokenFactory factory, Tokenizer tokenizer) Get the next token when the stack is empty.
protected Token	TokenStreamBaseImpl.getNext(TokenFactory factory, Tokenizer tokenizer) Get the next token when the stack is empty.

Methods in org.extex.scanner.base with parameters of type Token

void	TokenStreamBaseImpl.put(Token token) Push back a token into the stream.

Uses of Token in org.extex.scanner.stream.impl32

Methods in org.extex.scanner.stream.impl32 that return Token

protected Token

TokenStreamImpl.getNext(TokenFactory factory, Tokenizer tokenizer) Get the next token when the stack is empty.

Uses of Token in org.extex.scanner.type.token

Subinterfaces of Token in org.extex.scanner.type.token

interface

CodeToken The code token extends the Token with the ability to retrieve a name space.

Classes in org.extex.scanner.type.token that implement Token

class	AbstractToken This is the abstract base class for all Tokens.
class	ActiveCharacterToken This class represents an active character token.
class	ControlSequenceToken This class represents a control sequence token.
class	CrToken This class represents a carriage return token.
class	LeftBraceToken This class represents a left brace token.
class	LetterToken This class represents a letter token.
class	MacroParamToken This class represents a macro parameter token.
class	MathShiftToken This class represents a math shift token.
class	OtherToken This class represents an other token, this is one not covered by the other token classes.
class	RightBraceToken This class represents a right brace token.
class	SpaceToken This class represents a space token.
class	SubMarkToken This class represents a sub mark token.
class	SupMarkToken This class represents a super mark token.
class	TabMarkToken This class represents a tab mark token.

Methods in org.extex.scanner.type.token that return Token

Token	TokenFactoryImpl.createToken(Catcode code, int c, java.lang.String namespace) Create a new Token of the appropriate kind.
Token	TokenFactory.createToken(Catcode code, int c, java.lang.String namespace) Create a new Token of the appropriate kind.
Token	TokenFactoryImpl.createToken(Catcode code, UnicodeChar c, java.lang.String namespace) Get an instance of a token with a given Catcode and Unicode character value.
Token	TokenFactory.createToken(Catcode code, UnicodeChar c, java.lang.String namespace) Get an instance of a token with a given Catcode and Unicode character value.
Token	TokenFactoryImpl.createToken(Catcode code, UnicodeChar esc, java.lang.String value, java.lang.String namespace) Get an instance of a token with a given Catcode and value.
Token	TokenFactory.createToken(Catcode code, UnicodeChar esc, java.lang.String value, java.lang.String namespace) Get an instance of a token with a given Catcode and value.
Token	TokenFactoryImpl.visitActive(java.lang.String value, UnicodeChar uchar, java.lang.String namespace) Active characters are cached.
Token	TokenFactoryImpl.visitComment(java.lang.String value, UnicodeChar uchar, java.lang.String namespace) Comments are ignored thus null is returned in any case.
Token	TokenFactoryImpl.visitCr(java.lang.String value, UnicodeChar uchar, java.lang.String namespace) There is only one CrToken.
Token	TokenFactoryImpl.visitEscape(java.lang.String value, UnicodeChar uchar, java.lang.String namespace) This visit method is invoked on an escape token.
Token	TokenFactoryImpl.visitIgnore(java.lang.String value, UnicodeChar uchar, java.lang.String namespace) Ignored characters are simply ignored;-)
Token	TokenFactoryImpl.visitInvalid(java.lang.String value, UnicodeChar uchar, java.lang.String namespace) Invalid characters are ignored; even without any error message.
Token	TokenFactoryImpl.visitLeftBrace(java.lang.String value, UnicodeChar uchar, java.lang.String namespace) A left brace token is expected to take a single character only.
Token	TokenFactoryImpl.visitLetter(java.lang.String value, UnicodeChar uchar, java.lang.String namespace) A letter token is expected to take a single character only.
Token	TokenFactoryImpl.visitMacroParam(java.lang.String value, UnicodeChar uchar, java.lang.String namespace)
Token	TokenFactoryImpl.visitMathShift(java.lang.String value, UnicodeChar uchar, java.lang.String namespace)
Token	TokenFactoryImpl.visitOther(java.lang.String value, UnicodeChar uchar, java.lang.String namespace)
Token	TokenFactoryImpl.visitRightBrace(java.lang.String value, UnicodeChar uchar, java.lang.String namespace)
Token	TokenFactoryImpl.visitSpace(java.lang.String value, UnicodeChar uchar, java.lang.String namespace) There is only one space token.
Token	TokenFactoryImpl.visitSubMark(java.lang.String value, UnicodeChar uchar, java.lang.String namespace)
Token	TokenFactoryImpl.visitSupMark(java.lang.String value, UnicodeChar uchar, java.lang.String namespace)
Token	TokenFactoryImpl.visitTabMark(java.lang.String value, UnicodeChar uchar, java.lang.String namespace)

Uses of Token in org.extex.scanner.type.tokens

Methods in org.extex.scanner.type.tokens that return Token

Token	Tokens.get(int i) Get a specified token from the toks register.
Token	FixedTokens.get(int i) Get a specified token from the tokens register.
Token	Tokens.pop() Remove the first toke from the list and return it.
Token	Tokens.removeFirst() Remove the last token from the list and return it.
Token	Tokens.removeLast() Remove the last token from the list and return it.

Methods in org.extex.scanner.type.tokens that return types with arguments of type Token

java.util.Iterator<Token>

Tokens.iterator()

Methods in org.extex.scanner.type.tokens with parameters of type Token

void	Tokens.add(Token t) Add another token to the end of the Tokens.