|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectorg.apache.lucene.util.AttributeSource
org.apache.lucene.analysis.TokenStream
org.apache.lucene.analysis.Tokenizer
org.opensolaris.opengrok.analysis.JFlexTokenizer
org.opensolaris.opengrok.analysis.tcl.TclSymbolTokenizer
public class TclSymbolTokenizer
This class is a scanner generated by JFlex 1.4.1 on 12/14/10 11:51 AM from the specification file /home/mandrake/rpm/BUILD/opengrok-0.9-src/src/org/opensolaris/opengrok/analysis/tcl/TclSymbolTokenizer.lex
Nested Class Summary |
---|
Nested classes/interfaces inherited from class org.apache.lucene.util.AttributeSource |
---|
org.apache.lucene.util.AttributeSource.AttributeFactory, org.apache.lucene.util.AttributeSource.State |
Field Summary | |
---|---|
static int |
COMMENT
|
static int |
SCOMMENT
|
static int |
STRING
lexical states |
static int |
YYEOF
This character denotes the end of file |
static int |
YYINITIAL
|
Fields inherited from class org.opensolaris.opengrok.analysis.JFlexTokenizer |
---|
offsetAtt, posIncrAtt, termAtt |
Fields inherited from class org.apache.lucene.analysis.Tokenizer |
---|
input |
Constructor Summary | |
---|---|
TclSymbolTokenizer(java.io.InputStream in)
Creates a new scanner. |
|
TclSymbolTokenizer(java.io.Reader in)
Creates a new scanner There is also a java.io.InputStream version of this constructor. |
Method Summary | |
---|---|
void |
close()
|
void |
reInit(char[] buf,
int len)
|
void |
yybegin(int newState)
Enters a new lexical state |
char |
yycharat(int pos)
Returns the character at position pos from the matched text. |
void |
yyclose()
Closes the input stream. |
int |
yylength()
Returns the length of the matched text region. |
boolean |
yylex()
Resumes scanning until the next regular expression is matched, the end of input is encountered or an I/O-Error occurs. |
void |
yypushback(int number)
Pushes the specified amount of characters back into the input stream. |
void |
yyreset(java.io.Reader reader)
Resets the scanner to read from a new input stream. |
int |
yystate()
Returns the current lexical state. |
java.lang.String |
yytext()
Returns the text matched by the current regular expression. |
Methods inherited from class org.opensolaris.opengrok.analysis.JFlexTokenizer |
---|
incrementToken, setAttribs |
Methods inherited from class org.apache.lucene.analysis.Tokenizer |
---|
correctOffset, reset |
Methods inherited from class org.apache.lucene.analysis.TokenStream |
---|
end, reset |
Methods inherited from class org.apache.lucene.util.AttributeSource |
---|
addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, restoreState, toString |
Methods inherited from class java.lang.Object |
---|
clone, finalize, getClass, notify, notifyAll, wait, wait, wait |
Field Detail |
---|
public static final int YYEOF
public static final int STRING
public static final int YYINITIAL
public static final int COMMENT
public static final int SCOMMENT
Constructor Detail |
---|
public TclSymbolTokenizer(java.io.Reader in)
in
- the java.io.Reader to read input from.public TclSymbolTokenizer(java.io.InputStream in)
in
- the java.io.Inputstream to read input from.Method Detail |
---|
public void reInit(char[] buf, int len)
public void close() throws java.io.IOException
close
in interface java.io.Closeable
close
in class org.apache.lucene.analysis.Tokenizer
java.io.IOException
public final void yyclose() throws java.io.IOException
java.io.IOException
public final void yyreset(java.io.Reader reader)
reader
- the new input streampublic final int yystate()
public final void yybegin(int newState)
newState
- the new lexical statepublic final java.lang.String yytext()
public final char yycharat(int pos)
pos
- the position of the character to fetch.
A value from 0 to yylength()-1.
public final int yylength()
public void yypushback(int number)
number
- the number of characters to be read again.
This number must not be greater than yylength()!public boolean yylex() throws java.io.IOException
yylex
in class JFlexTokenizer
java.io.IOException
- if any I/O-Error occurs
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |