|
|
953870fae0
|
Check for EOF ("\0") when reading comments
|
2016-12-25 14:34:11 -07:00 |
|
|
|
b2f7afef07
|
Lexer::new takes a &str instead of a String
|
2016-12-25 14:33:58 -07:00 |
|
|
|
7f19c78127
|
Make some unit tests for the lexer
|
2016-12-25 14:20:25 -07:00 |
|
|
|
7e784ffce1
|
Make the Lex at the end, make tokens in state methods
|
2016-12-25 14:20:16 -07:00 |
|
|
|
0d89cfefc1
|
Add Comment token
|
2016-12-25 13:50:34 -07:00 |
|
|
|
acbde03786
|
Token is an enum with values; Lex contains a token and several useful bits of info
|
2016-12-25 12:24:04 -07:00 |
|
|
|
6b8ba6b6e8
|
use #[derive(Debug)] on Token, Kind, State... SO MUCH EASIER
|
2016-12-24 14:03:37 -07:00 |
|
|
|
c84251b56f
|
Display for State enum
|
2016-12-24 10:29:24 -07:00 |
|
|
|
43054b3f49
|
Lex hashes and booleans
|
2016-12-24 10:29:12 -07:00 |
|
|
|
e9b0eab38a
|
Sort out advancing pointers for whitespace
|
2016-12-24 09:59:35 -07:00 |
|
|
|
8140e3c5e6
|
Pass over whitespace and count lines
|
2016-12-24 09:17:08 -07:00 |
|
|
|
f7c28c6732
|
Add single character identifiers
|
2016-12-24 09:07:38 -07:00 |
|
|
|
f7cedb3536
|
Doc clean up
|
2016-12-24 09:05:10 -07:00 |
|
|
|
d4dee92904
|
Move all the lexer stuff to a module directory
|
2016-12-24 08:57:37 -07:00 |
|
|
|
d333819dee
|
Break token stuff into a separate source file
|
2016-12-24 08:47:02 -07:00 |
|
|
|
8d9cfd86f8
|
Move lexer.rs to lexer/mod.rs
|
2016-12-24 08:41:18 -07:00 |
|
