Module ketos::lexer [] [src]

Produces tokens from an input stream.

Structs

CodeMap

Contains source code of parsed programs

Lexer

Produces Tokens from an input string.

Span

Represents a beginning and end point within a body of text.

SpanDisplay

Produced by highlight_span to help in printing a line of code with a span highlighted.

Enums

Token

Represents a single unit of code input.

Functions

highlight_span

Returns a structure which helps in highlighting a span within a body of text.

Type Definitions

BytePos

Represents a byte position within an input stream.