Documentation
¶
Index ¶
- Constants
- func HasUChars(r rune, l *Lexer) bool
- func IsIRIChar(r rune, l *Lexer) bool
- func LexIRIRef(l *Lexer, styp ItemType) error
- type CheckRune
- type CheckRuneRec
- type Item
- type ItemIterator
- type ItemType
- type Lexer
- func (l *Lexer) AcceptRun(c CheckRune) (lastr rune, validr bool)
- func (l *Lexer) AcceptRunRec(c CheckRuneRec)
- func (l *Lexer) AcceptRunTimes(c CheckRune, times int) int
- func (l *Lexer) AcceptUntil(c CheckRune)
- func (l *Lexer) Backup()
- func (l *Lexer) Emit(t ItemType)
- func (l *Lexer) Errorf(format string, args ...interface{}) StateFn
- func (l *Lexer) Ignore()
- func (l *Lexer) IgnoreRun(c CheckRune)
- func (l *Lexer) IsEscChar(r rune) bool
- func (l *Lexer) LexQuotedString() error
- func (l *Lexer) NewIterator() *ItemIterator
- func (l *Lexer) Next() (result rune)
- func (l *Lexer) Peek() rune
- func (l *Lexer) Run(f StateFn) *Lexer
- type StateFn
Constants ¶
const EOF = -1
Variables ¶
This section is empty.
Functions ¶
func HasUChars ¶ added in v0.7.3
UCHAR ::= '\u' HEX HEX HEX HEX | '\U' HEX HEX HEX HEX HEX HEX HEX HEX
Types ¶
type CheckRuneRec ¶ added in v0.7.2
CheckRuneRec is like CheckRune with Lexer as extra argument. This can be used to recursively call other CheckRune(s).
type ItemIterator ¶ added in v0.7.2
type ItemIterator struct {
// contains filtered or unexported fields
}
func (*ItemIterator) Item ¶ added in v0.7.2
func (p *ItemIterator) Item() Item
Item returns the current item.
func (*ItemIterator) Next ¶ added in v0.7.2
func (p *ItemIterator) Next() bool
Next advances the iterator by one.
func (*ItemIterator) Peek ¶ added in v0.7.2
func (p *ItemIterator) Peek(num int) ([]Item, error)
Peek returns the next n items without consuming them.
func (*ItemIterator) PeekOne ¶ added in v0.8.2
func (p *ItemIterator) PeekOne() (Item, bool)
PeekOne returns the next 1 item without consuming it.
func (*ItemIterator) Prev ¶ added in v0.7.2
func (p *ItemIterator) Prev() bool
Prev moves the index back by one.
func (*ItemIterator) Restore ¶ added in v0.8.2
func (p *ItemIterator) Restore(pos int)
Restore restores the the iterator to position specified.
func (*ItemIterator) Save ¶ added in v0.8.2
func (p *ItemIterator) Save() int
Save returns the current position of the iterator which we can use for restoring later.
type ItemType ¶
type ItemType int
ItemType is used to set the type of a token. These constants can be defined in the file containing state functions. Note that their value should be >= 5.
type Lexer ¶
type Lexer struct {
// NOTE: Using a text scanner wouldn't work because it's designed for parsing
// Golang. It won't keep track of Start Position, or allow us to retrieve
// slice from [Start:Pos]. Better to just use normal string.
Input string // string being scanned.
Start int // Start Position of this item.
Pos int // current Position of this item.
Width int // Width of last rune read from input.
Depth int // nesting of {}
ArgDepth int // nesting of ()
Mode StateFn // Default state to go back to after reading a token.
// contains filtered or unexported fields
}
func (*Lexer) AcceptRun ¶
AcceptRun accepts tokens based on CheckRune untill it returns false or EOF is reached. Returns last rune accepted and valid flag for rune.
func (*Lexer) AcceptRunRec ¶ added in v0.7.2
func (l *Lexer) AcceptRunRec(c CheckRuneRec)
AcceptRunRec accepts tokens based on CheckRuneRec untill it returns false or EOF is reached.
func (*Lexer) AcceptRunTimes ¶ added in v0.7.2
AcceptRunTimes accepts tokens with CheckRune given number of times. returns number of times it was successful.
func (*Lexer) AcceptUntil ¶
AcceptUntil accepts tokens based on CheckRune till it returns false or EOF is reached.
func (*Lexer) LexQuotedString ¶ added in v0.8.2
func (*Lexer) NewIterator ¶ added in v0.7.2
func (l *Lexer) NewIterator() *ItemIterator
Source Files