dlangui v0.9.186 (2020-07-29T06:28:30Z)
Home
Dub
Repo
Tokenizer.this
dlangui
dml
tokenizer
Tokenizer
Undocumented in source.
class
Tokenizer
this
(
string
source
,
string
filename
= ""
,
string
[]
singleLineCommentPrefixes
= ["//"]
)
Meta
Source
See Implementation
dlangui
dml
tokenizer
Tokenizer
constructors
this
destructors
~this
enums
EOF_CHAR
functions
emitError
getContextSource
nextChar
nextToken
parseEof
parseEol
parseError
parseFloating
parseHex
parseIdent
parseMultiLineComment
parseNumber
parseOp
parseSingleLineComment
parseString
parseWhiteSpace
peekChar
peekNextChar
setTokenStart
skipChar
properties
filename
line
pos
static functions
isAlpha
isAlphaNum
isNum
variables
_filename
_len
_line
_lineText
_lines
_pos
_prevChar
_singleLineCommentPrefixes
_token