| Value | Meaning |
|---|---|
| WhiteSpace(0 << TOKEN_CATEGORY_SHIFT) | |
| WhiteSpace_Space(0 << TOKEN_CATEGORY_SHIFT) | 1 | |
| WhiteSpace_Tab(0 << TOKEN_CATEGORY_SHIFT) | 2 | |
| Comment(1 << TOKEN_CATEGORY_SHIFT) | |
| Comment_SingleLine(1 << TOKEN_CATEGORY_SHIFT) | 1 | |
| Comment_SingleLineDoc(1 << TOKEN_CATEGORY_SHIFT) | 2 | |
| Comment_MultyLine(1 << TOKEN_CATEGORY_SHIFT) | 3 | |
| Comment_MultyLineDoc(1 << TOKEN_CATEGORY_SHIFT) | 4 | |
| Comment_Documentation(1 << TOKEN_CATEGORY_SHIFT) | 5 | |
| Identifier(2 << TOKEN_CATEGORY_SHIFT) | |
| Identifier_Class(2 << TOKEN_CATEGORY_SHIFT) | 1 | |
| Identifier_Struct(2 << TOKEN_CATEGORY_SHIFT) | 2 | |
| Identifier_Local(2 << TOKEN_CATEGORY_SHIFT) | 3 | |
| Identifier_Member(2 << TOKEN_CATEGORY_SHIFT) | 4 | |
| Identifier_Deprecated(2 << TOKEN_CATEGORY_SHIFT) | 15 | |
| String(3 << TOKEN_CATEGORY_SHIFT) | string literal |
| Character(4 << TOKEN_CATEGORY_SHIFT) | character literal |
| Integer(5 << TOKEN_CATEGORY_SHIFT) | integer literal |
| Float(6 << TOKEN_CATEGORY_SHIFT) | floating point number literal |
| Keyword(7 << TOKEN_CATEGORY_SHIFT) | keyword |
| Op(8 << TOKEN_CATEGORY_SHIFT) | operator |
| Error(15 << TOKEN_CATEGORY_SHIFT) | error - unparsed character sequence |
| Error_InvalidToken(15 << TOKEN_CATEGORY_SHIFT) | 1 | invalid token - generic |
| Error_InvalidNumber(15 << TOKEN_CATEGORY_SHIFT) | 2 | invalid number token - error occured while parsing number |
| Error_InvalidString(15 << TOKEN_CATEGORY_SHIFT) | 3 | invalid string token - error occured while parsing string |
| Error_InvalidIdentifier(15 << TOKEN_CATEGORY_SHIFT) | 4 | invalid identifier token - error occured while parsing identifier |
| Error_InvalidComment(15 << TOKEN_CATEGORY_SHIFT) | 7 | invalid comment token - error occured while parsing comment |
| Error_InvalidOp(15 << TOKEN_CATEGORY_SHIFT) | 8 | invalid comment token - error occured while parsing comment |
token category for syntax highlight