Specifies the token types that can be identified and returned by the language service scanner.
Assembly: Microsoft.SqlServer.Management.SqlParser (in Microsoft.SqlServer.Management.SqlParser.dll)
A comment. A comment is bounded by /* and */, or is preceded by --.
This is typically used for any token that the parser does not recognize, and should be considered an error in the code that is being parsed.
An identifier or name. For example, the name of a variable.
A language keyword. This is an identifier that is reserved by the language. For example, CREATE, WITH, TABLE, and so on.
A numeric literal.
A SQL Server command.
An operator. For example, +, =, LIKE, and so on.
A stored procedure.
A Transact-SQL string.
A system function.
A system table.
General text. This is any text that is not identified as a specified token type.