Definitions of all tokens involved in the lexical analysis.

This class is not documented because it is so deep in the internals.