tokenize

tokenize source into array of tokens (excluding EOF)

public

tokenize

(

string code

,

string[] _singleLineCommentPrefixes = ["//"]

,

bool skipSpace = false

,

bool skipEols = false

,

bool skipComments = false

)

Meta

Source

See Implementation

dlangui dml tokenizer classes

enums

TokenType

functions

structs

Token