Uses of Class
org.extex.scanner.type.tokens.Tokens

Packages that use Tokens

org.extex.base.type.file	This package contains the basic file data types for ExTeX.
org.extex.interpreter	This package contains the macro expansion engine and all supporting classes.
org.extex.interpreter.context	This package contains the container for data in the interpreter.
org.extex.interpreter.context.observer.tokens	This package contains definitions for a tokens change observer.
org.extex.interpreter.max	This package contains the macro expansion engine and supporting classes.
org.extex.interpreter.max.context	This package contains a reference implementation for the Context.
org.extex.interpreter.primitives.format
org.extex.interpreter.primitives.register.bool	This package contains primitives for the manipulation of bool registers.
org.extex.interpreter.primitives.register.hash	This package contains primitives for the manipulation of hash - toks registers.
org.extex.interpreter.primitives.register.pair	This package contains primitives for the manipulation of pair registers.
org.extex.interpreter.primitives.register.real	This package contains primitives for the manipulation of real registers.
org.extex.interpreter.primitives.register.transform	This package contains primitives for the manipulation of transform registers.
org.extex.interpreter.type	This package contains the basic data types for ExTeX.
org.extex.interpreter.type.box	This package contains the basic box data types for ExTeX.
org.extex.interpreter.type.tokens
org.extex.language.hyphenation	This package contains the definitions and implementations for the treatment of hyphenations in ExTeX.
org.extex.language.hyphenation.base	This package contains the base hyphenation table implementation.
org.extex.language.hyphenation.liang	This package contains a implementation for an hyphenation engine.
org.extex.language.impl	This package contains implementations which describe a language.
org.extex.scanner.base	This package contains a basic implementation for a TokenStream.
org.extex.scanner.type.file
org.extex.scanner.type.token	This package contains the token types for the scanner of ExTeX.
org.extex.scanner.type.tokens	This package contains the basic tokens data types for ExTeX.
org.extex.typesetter	This package contains the typesetter definitions for ExTeX.
org.extex.typesetter.type.node	This package contains the basic data types for nodes as stored in boxed and processed by the typesetter in ExTeX.
org.extex.unit.base.register	This package contains register primitives for the ExTeX engine.
org.extex.unit.base.register.count	This package contains support classes for the integer numbers.
org.extex.unit.base.register.font	This package contains primitives for the manipulation of font registers.
org.extex.unit.base.register.toks	This package contains token register primitives for the ExTeX engine.
org.extex.unit.color	This package contains primitives for colors.
org.extex.unit.etex.conditional.analyze	This package contains primitives for analyzing conditionals.
org.extex.unit.etex.font	This package contains primitives to handle fonts in unit etex.
org.extex.unit.etex.group
org.extex.unit.etex.interaction	This package contains primitives to alter the interaction mode.
org.extex.unit.etex.register.count
org.extex.unit.etex.register.dimen	This package contains primitives for the manipulation of dimen registers.
org.extex.unit.etex.register.skip
org.extex.unit.etex.typesetter.paragraph
org.extex.unit.extex.backend
org.extex.unit.namespace	This package contains primitives for namespaces.
org.extex.unit.omega.math
org.extex.unit.omega.math.delimiter
org.extex.unit.omega.math.util
org.extex.unit.omega.ocp	This package contains primitives defined in Omega.
org.extex.unit.omega.ocp.util	This package contains utilities for OCPs.
org.extex.unit.omega.register	This package contains primitives defined in Omega for analyzing registers.
org.extex.unit.pdftex	This package contains primitives for ExTeX's pdfTeX mode.
org.extex.unit.tex.file	This package contains primitives to handle files.
org.extex.unit.tex.file.nodes	This package contains node types used for handling delayed file operations.
org.extex.unit.tex.font	This package contains primitives related to fonts and their management.
org.extex.unit.tex.hyphen	This package contains the primitives for hyphenations in ExTeX.
org.extex.unit.tex.info	This package contains primitives for debugging.
org.extex.unit.tex.macro	This package contains primitives for the management of macros.
org.extex.unit.tex.macro.util	This package contains utilities for the management of macros.
org.extex.unit.tex.math	This package contains math primitives for ExTeX.
org.extex.unit.tex.math.delimiter	This package contains math primitives for ExTeX.
org.extex.unit.tex.math.util	This package contains math utility classes.
org.extex.unit.tex.register	This package contains primitives for the manipulation of registers.
org.extex.unit.tex.register.box	This package contains primitives for the manipulation of box registers.
org.extex.unit.tex.register.count	This package contains primitives for the manipulation of count registers.
org.extex.unit.tex.register.dimen	This package contains primitives for the manipulation of dimen registers.
org.extex.unit.tex.register.muskip	This package contains primitives for the manipulation of muskip registers.
org.extex.unit.tex.register.skip	This package contains primitives for the manipulation of skip registers.
org.extex.unit.tex.register.toks	This package contains primitives for the manipulation of toks registers.
org.extex.unit.tex.string	This package contains primitives for the manipulation of strings.
org.extex.unit.tex.table.util	This package contains utility classes for the processing of alignment tables.
org.extex.unit.tex.typesetter.mark	This package contains primitives which deal with marks.
org.extex.unit.tex.typesetter.paragraph	This package contains primitives which deal with paragraph building.
org.extex.unit.tex.typesetter.parameter
org.extex.unit.tex.typesetter.undo	This package contains primitives which deal with decomposing boxes.

Uses of Tokens in org.extex.base.type.file

Methods in org.extex.base.type.file that return Tokens

Tokens

InputFile.read(TokenFactory factory, Tokenizer tokenizer) Read a line of characters into a tokens list.

Methods in org.extex.base.type.file with parameters of type Tokens

boolean	UserAndLogFile.write(Tokens toks) Write some tokens to the output writer.
boolean	ExecuteFile.write(Tokens toks) Write some tokens to the output writer.
boolean	LogFile.write(Tokens toks) Write some tokens to the output writer.
boolean	OutputFile.write(Tokens toks) Write some tokens to the output writer.

Uses of Tokens in org.extex.interpreter

Methods in org.extex.interpreter that return Tokens

Tokens	TokenSource.expand(Tokens tokens, Typesetter typesetter) Expand some tokens.
Tokens	TokenSource.getTokens(Context context, TokenSource source, Typesetter typesetter) Get the next tokens form the input streams between { and }.
Tokens	TokenSource.scanTokens(Context context, boolean reportUndefined, boolean ignoreUndefined, CodeToken primitive) Get the next expanded token form the input streams between { and }.
Tokens	TokenSource.scanUnprotectedTokens(Context context, boolean reportUndefined, boolean ignoreUndefined, CodeToken primitive) Get the next expanded tokens from the input streams between { and }.

Methods in org.extex.interpreter with parameters of type Tokens

Tokens	TokenSource.expand(Tokens tokens, Typesetter typesetter) Expand some tokens.
void	TokenSource.push(Tokens tokens) Push back a list of tokens onto the input stream for subsequent reading.

Uses of Tokens in org.extex.interpreter.context

Methods in org.extex.interpreter.context that return Tokens

Tokens	ContextMark.getBottomMark(java.lang.Object name) Getter for the bottom mark.
Tokens	ContextMark.getFirstMark(java.lang.Object name) Getter for the first mark.
Tokens	ContextMark.getSplitBottomMark(java.lang.Object name) Getter for the split bottom mark.
Tokens	ContextMark.getSplitFirstMark(java.lang.Object name) Getter for the split first mark.
Tokens	ContextTokens.getToks(java.lang.String name) Getter for the Tokens register.
Tokens	ContextTokens.getToksOrNull(java.lang.String name) Getter for the toks register.
Tokens	ContextMark.getTopMark(java.lang.Object name) Getter for the top mark.

Methods in org.extex.interpreter.context with parameters of type Tokens

void	ContextMark.setMark(java.lang.Object name, Tokens mark) Setter for a mark.
void	ContextMark.setSplitMark(java.lang.Object name, Tokens mark) Setter for a split mark.
void	ContextTokens.setToks(java.lang.String name, Tokens toks, boolean global) Setter for the Tokens register in the specified groups.

Uses of Tokens in org.extex.interpreter.context.observer.tokens

Methods in org.extex.interpreter.context.observer.tokens with parameters of type Tokens

void	TokensObserver.receiveTokensChange(ContextInternals context, java.lang.String name, Tokens value) Receive a notification on a tokens change.

Uses of Tokens in org.extex.interpreter.max

Methods in org.extex.interpreter.max that return Tokens

Tokens	Max.expand(Tokens tokens, Typesetter typesetter) Expand some tokens.
Tokens	Moritz.getTokens(Context context, TokenSource source, Typesetter typesetter) Get the next tokens form the input streams between { and }.
Tokens	Moritz.scanTokens(Context context, boolean reportUndefined, boolean ignoreUndefined, CodeToken primitive) Get the next expanded token form the input streams between { and }.
Tokens	Moritz.scanUnprotectedTokens(Context context, boolean reportUndefined, boolean ignoreUndefined, CodeToken primitive) Get the next expanded tokens from the input streams between { and }.

Methods in org.extex.interpreter.max with parameters of type Tokens

Tokens	Max.expand(Tokens tokens, Typesetter typesetter) Expand some tokens.
protected Token	Max.expandUnproteced(Token token, Tokens tokens) Take the token given and expand it as possible while honoring the protected code.
void	Moritz.push(Tokens tokens) Push back a list of tokens onto the input stream for subsequent reading.

Uses of Tokens in org.extex.interpreter.max.context

Methods in org.extex.interpreter.max.context that return Tokens

Tokens	GroupImpl.getAfterGroup() Getter for the tokens which are inserted after the group has been closed.
Tokens	Group.getAfterGroup() Getter for the tokens which are inserted after the group has been closed.
Tokens	ContextImpl.getBottomMark(java.lang.Object name) Getter for the bottom mark.
Tokens	ContextImpl.getFirstMark(java.lang.Object name)
Tokens	ContextImpl.getSplitBottomMark(java.lang.Object name) Getter for the split bottom mark.
Tokens	ContextImpl.getSplitFirstMark(java.lang.Object name) Getter for the split first mark.
Tokens	GroupImpl.getToks(java.lang.String name) Getter for the named toks register in the current group.
Tokens	Group.getToks(java.lang.String name) Getter for the named toks register in the current group.
Tokens	ContextImpl.getToks(java.lang.String name)
Tokens	GroupImpl.getToksOrNull(java.lang.String name) Getter for the named toks register in the current group.
Tokens	Group.getToksOrNull(java.lang.String name) Getter for the named toks register in the current group.
Tokens	ContextImpl.getToksOrNull(java.lang.String name)
Tokens	ContextImpl.getTopMark(java.lang.Object name)

Methods in org.extex.interpreter.max.context with parameters of type Tokens

void	LanguageObserver.receiveTokensChange(ContextInternals context, java.lang.String name, Tokens value) Receive a notification on a tokens change.
void	ContextImpl.setMark(java.lang.Object name, Tokens mark) Setter for a mark.
void	ContextImpl.setSplitMark(java.lang.Object name, Tokens mark) Setter for a split mark.
void	GroupImpl.setToks(java.lang.String name, Tokens value, boolean global) Setter for a toks register in all groups.
void	Group.setToks(java.lang.String name, Tokens value, boolean global) Setter for a toks register in all groups.
void	ContextImpl.setToks(java.lang.String name, Tokens toks, boolean global) Setter for the Tokens register in the specified groups.

Uses of Tokens in org.extex.interpreter.primitives.format

Methods in org.extex.interpreter.primitives.format that return Tokens

Tokens

PrintFormat.the(Context context, TokenSource source, Typesetter typesetter)

Uses of Tokens in org.extex.interpreter.primitives.register.bool

Methods in org.extex.interpreter.primitives.register.bool that return Tokens

Tokens

NamedBool.the(Context context, TokenSource source, Typesetter typesetter) This method is the getter for the description of the primitive.

Uses of Tokens in org.extex.interpreter.primitives.register.hash

Methods in org.extex.interpreter.primitives.register.hash that return Tokens

Tokens	HashToks.get(java.lang.String key) Return the tokens for a key.
Tokens	NamedHashToks.the(Context context, TokenSource source, Typesetter typesetter) This method is the getter for the description of the primitive.

Methods in org.extex.interpreter.primitives.register.hash with parameters of type Tokens

void	HashToks.put(java.lang.String key, Tokens toks) Put the tokens on the hash with the key.

Uses of Tokens in org.extex.interpreter.primitives.register.pair

Methods in org.extex.interpreter.primitives.register.pair that return Tokens

Tokens

NamedPair.the(Context context, TokenSource source, Typesetter typesetter) This method is the getter for the description of the primitive.

Uses of Tokens in org.extex.interpreter.primitives.register.real

Methods in org.extex.interpreter.primitives.register.real that return Tokens

Tokens	NamedReal.the(Context context, TokenSource source, Typesetter typesetter) This method is the getter for the description of the primitive.
Tokens	AbstractMath.the(Context context, TokenSource source, Typesetter typesetter) This method is the getter for the description of the primitive.

Uses of Tokens in org.extex.interpreter.primitives.register.transform

Methods in org.extex.interpreter.primitives.register.transform that return Tokens

Tokens

NamedTransform.the(Context context, TokenSource source, Typesetter typesetter) This method is the getter for the description of the primitive.

Uses of Tokens in org.extex.interpreter.type

Methods in org.extex.interpreter.type that return Tokens

Tokens	Showable.show(Context context) This method is the getter for the description of the primitive.
Tokens	Theable.the(Context context, TokenSource source, Typesetter typesetter) This method is the getter for the description of the primitive.

Methods in org.extex.interpreter.type with parameters of type Tokens

void	CodeExpander.expandCode(Context context, TokenSource source, Typesetter typesetter, Tokens tokens) Expand the first token and place the result in a token list.
OutFile	TokensWriter.write(java.lang.String key, Tokens toks, Context context) Immediately write some tokens to a write register.

Uses of Tokens in org.extex.interpreter.type.box

Constructors in org.extex.interpreter.type.box with parameters of type Tokens

Box(Context context, TokenSource source, Typesetter typesetter, boolean isHorizontal, Tokens insert, GroupType groupType, Token startToken)
Creates a new object.

Uses of Tokens in org.extex.interpreter.type.tokens

Methods in org.extex.interpreter.type.tokens that return Tokens

Tokens

TokensConvertible.convertTokens(Context context, TokenSource source, Typesetter typesetter) This method converts a register into tokens.

Uses of Tokens in org.extex.language.hyphenation

Methods in org.extex.language.hyphenation with parameters of type Tokens

void	Hyphenator.addPattern(Tokens pattern) Add a pattern to the hyphenation table.

Uses of Tokens in org.extex.language.hyphenation.base

Methods in org.extex.language.hyphenation.base with parameters of type Tokens

void	BaseHyphenationTable.addPattern(Tokens pattern) Add a pattern to the hyphenation table.

Uses of Tokens in org.extex.language.hyphenation.liang

Methods in org.extex.language.hyphenation.liang with parameters of type Tokens

void	LiangsHyphenationTable.addPattern(Tokens pattern) This methods allows the caller to add another pattern

Uses of Tokens in org.extex.language.impl

Methods in org.extex.language.impl with parameters of type Tokens

void	FutureLanguage.addPattern(Tokens pattern) Add a pattern to the hyphenation table.

Uses of Tokens in org.extex.scanner.base

Constructors in org.extex.scanner.base with parameters of type Tokens

TokenStreamBaseImpl(boolean isFile, Tokens tokens)
Creates a new object.

Uses of Tokens in org.extex.scanner.type.file

Methods in org.extex.scanner.type.file that return Tokens

Tokens

InFile.read(TokenFactory factory, Tokenizer tokenizer) Read a line of characters into a tokens list.

Methods in org.extex.scanner.type.file with parameters of type Tokens

boolean

OutFile.write(Tokens toks) Write some tokens to the output writer.

Uses of Tokens in org.extex.scanner.type.token

Methods in org.extex.scanner.type.token that return Tokens

Tokens	TokenFactoryImpl.toTokens(java.lang.CharSequence s) Convert a character sequence to a list of tokens.
Tokens	TokenFactory.toTokens(java.lang.CharSequence s) Convert a character sequence to a list of tokens.
Tokens	TokenFactoryImpl.toTokens(long l) Convert a long value into a list of tokens.
Tokens	TokenFactory.toTokens(long l) Convert a long value into a list of tokens.

Uses of Tokens in org.extex.scanner.type.tokens

Subclasses of Tokens in org.extex.scanner.type.tokens

class

ImmutableTokens This class presents a Tokens register where all setters are disabled.

Fields in org.extex.scanner.type.tokens declared as Tokens

static Tokens

Tokens.EMPTY This constant is the empty token register.

Methods in org.extex.scanner.type.tokens with parameters of type Tokens

void	Tokens.add(Tokens toks) Add another token list to the end of the Tokens.
void	ImmutableTokens.add(Tokens toks) Add another token list to the end of the Tokens.
void	Tokens.show(Tokens toks, TokenFactory factory, long esc) Determine the printable representation of the object and append it to a list of Tokens.

Uses of Tokens in org.extex.typesetter

Methods in org.extex.typesetter with parameters of type Tokens

void	PageContext.setMark(java.lang.Object index, Tokens mark) Setter for a mark.

Uses of Tokens in org.extex.typesetter.type.node

Methods in org.extex.typesetter.type.node that return Tokens

Tokens

MarkNode.getMark() Getter for mark.

Constructors in org.extex.typesetter.type.node with parameters of type Tokens

MarkNode(Tokens mark, java.lang.String index)
Creates a new object.

Uses of Tokens in org.extex.unit.base.register

Methods in org.extex.unit.base.register that return Tokens

Tokens	CharCode.show(Context context) This method is the getter for the description of the primitive.
Tokens	CharCode.the(Context context, TokenSource source, Typesetter typesetter) This method is the getter for the description of the primitive.

Uses of Tokens in org.extex.unit.base.register.count

Methods in org.extex.unit.base.register.count that return Tokens

Tokens

IntegerCode.the(Context context, TokenSource source, Typesetter typesetter) This method is the getter for the description of the primitive.

Uses of Tokens in org.extex.unit.base.register.font

Methods in org.extex.unit.base.register.font that return Tokens

Tokens	NamedFont.the(Context context, TokenSource source, Typesetter typesetter) This method is the getter for the description of the primitive.
Tokens	FontCode.the(Context context, TokenSource source, Typesetter typesetter) This method is the getter for the description of the primitive.

Uses of Tokens in org.extex.unit.base.register.toks

Methods in org.extex.unit.base.register.toks that return Tokens

Tokens	ToksParameter.convertTokens(Context context, TokenSource source, Typesetter typesetter) This method converts a register into tokens.
Tokens	ToksParameter.the(Context context, TokenSource source, Typesetter typesetter) Return the register value as Tokens for \the.

Uses of Tokens in org.extex.unit.color

Methods in org.extex.unit.color that return Tokens

Tokens	AbstractColor.show(Context context) This method is the getter for the description of the primitive.
Tokens	AbstractColor.the(Context context, TokenSource source, Typesetter typesetter) This method is the getter for the description of the primitive.

Uses of Tokens in org.extex.unit.etex.conditional.analyze

Methods in org.extex.unit.etex.conditional.analyze that return Tokens

Tokens	Currentiflevel.the(Context context, TokenSource source, Typesetter typesetter) This method is the getter for the description of the primitive.
Tokens	Currentiftype.the(Context context, TokenSource source, Typesetter typesetter) This method is the getter for the description of the primitive.
Tokens	Currentifbranch.the(Context context, TokenSource source, Typesetter typesetter) This method is the getter for the description of the primitive.

Uses of Tokens in org.extex.unit.etex.font

Methods in org.extex.unit.etex.font that return Tokens

Tokens	Fontchardp.the(Context context, TokenSource source, Typesetter typesetter) This method is the getter for the description of the primitive.
Tokens	Fontcharic.the(Context context, TokenSource source, Typesetter typesetter) This method is the getter for the description of the primitive.
Tokens