Namespace CilTools.Syntax.Tokens

Represents a token definition for a single line comment (// Hello, world)

Represents a token definition for double-quoted text literal ("Hello, world")

Represents a token definition for a multiline comment (/Hello, world/)

Represents a token definition for a numeric literal token (integer of floating point)

Represents a token definition for a punctuation token

Represents a token definition for single-quoted text literal ('x')

Reads tokens from a string and transforms them into corresponding SyntaxNode instances

A base class for classes that define logic for reading specific kinds of tokens from a string

Reads raw tokens from a string using the specified collection of token definitions

Represents a whitespace that separates tokens.