Details
Improvement
Closed
Major
Description
Lexer currently swallows insignificant whitespace, insignificant newlines, single-line comments and multi-line comments.
While these elements are not needed for code generation they are needed for other code inspections purposes like IDE-integration and pretty-priting.
The idea would be to set flags on the lexer/parser whether to return these token types.
implemented by John Rose.
Lexer now has Method setWhitespaceIncluded(boolean) that does the job.