Enum ketos::lexer::Token
[−]
[src]
pub enum Token<'lex> { LeftParen, RightParen, DocComment(&'lex str), Float(&'lex str), Integer(&'lex str, u32), Ratio(&'lex str), Char(&'lex str), String(&'lex str), Byte(&'lex str), Bytes(&'lex str), Path(&'lex str), Name(&'lex str), Keyword(&'lex str), BackQuote, Comma, CommaAt, Quote, End, }
Represents a single unit of code input.
Variants
LeftParen
Left parenthesis (
RightParen
Right parenthesis )
DocComment(&'lex str)
A series of line comments beginning with ;;
,
used to document declared values.
Float(&'lex str)
Floating point literal
Integer(&'lex str, u32)
Integer literal in a given radix
Ratio(&'lex str)
Ratio literal
Char(&'lex str)
Character literal
String(&'lex str)
String literal
Byte(&'lex str)
Byte literal
Bytes(&'lex str)
Byte string literal
Path(&'lex str)
Path literal
Name(&'lex str)
Identifier name
Keyword(&'lex str)
Identifier keyword
BackQuote
Backtick quote `
Comma
Comma ,
CommaAt
Comma followed by at ,@
Quote
Single-quote '
End
End of input stream
Methods
impl<'lex> Token<'lex>
[src]
Trait Implementations
impl<'lex> Copy for Token<'lex>
[src]
impl<'lex> Clone for Token<'lex>
[src]
fn clone(&self) -> Token<'lex>
Returns a copy of the value. Read more
fn clone_from(&mut self, source: &Self)
1.0.0
Performs copy-assignment from source
. Read more