Tokens
Back to The CompilerA token is:
- a keyword
- an identifier
- a constant
- a string literal
- a symbol
- one or more punctuations
- that function as operators or digraphs
- something of syntactic importance, like semicolons or braces
Parsing a Token
As a rule, while parsing tokens, the compiler willappend each successive non-white character
to the existing token unless
it would make the valid token invalid.
| 21nov16 | admin |