Creates a Lexer.
used for error messages
source code, ending in a 0 byte
starting offset into base[]
last offset into base[]
handle documentation comments
comments become TOKcomment's
See Implementation
Creates a Lexer.