Commit graph

274 commits

Author SHA1 Message Date
d333819dee Break token stuff into a separate source file 2016-12-24 08:47:02 -07:00
8d9cfd86f8 Move lexer.rs to lexer/mod.rs 2016-12-24 08:41:18 -07:00
f1d15d5cef Documentation and some clean up 2016-12-23 17:53:28 -07:00
089425ab0f Remove the demo stuff 2016-12-23 17:48:19 -07:00
e6ca40122e Print out tokens as they come 2016-12-23 17:46:36 -07:00
b1051f5f74 Do actual (quite simplified) lexing! 2016-12-23 17:46:28 -07:00
9561e1bf91 Add Display trait to Token and Kind 2016-12-23 17:45:37 -07:00
79080ff62b CharAt trait, applied to str 2016-12-23 17:44:44 -07:00
fcb7a79721 Some unit tests for the RelativeIndexable methods 2016-12-23 17:44:28 -07:00
4bd1d2c9c2 Redo how index_before and index_after work 2016-12-23 17:43:46 -07:00
fa2ff9e8ce chars are Lexable 2016-12-23 17:38:33 -07:00
e13b2c24de Laying some groundwork for actual lexing... 2016-12-22 09:25:31 -08:00
2c9b024ac5 index_before and index_after return Option<usize> instead of just usize 2016-12-22 09:25:10 -08:00
93353f0f9e Documentation for the set functions in characters.rs 2016-12-22 09:24:53 -08:00
fbf1d07e27 Iterate lexer 2016-12-20 17:52:46 -08:00
7de54a9835 Make public lexer bits public 2016-12-20 17:52:29 -08:00
837403949e Fix off by one 2016-12-20 17:52:00 -08:00
08bbaeb7cf Make ascii_* sets private to characters 2016-12-20 17:51:43 -08:00
7c43e93470 Rustify my syntax 2016-12-20 17:51:13 -08:00
f02240da87 Add characters module 2016-12-20 17:38:51 -08:00
ac4cff9a51 Add a bunch of character stuff to the lexer module 2016-12-19 22:23:27 -08:00
9e51659a30 Ignore Rust build artifacts 2016-12-19 14:02:19 -08:00
a5220fdbaf Add initial sibil Rust project 2016-12-19 14:01:55 -08:00
0416c6ac7d Initial commit
Add README.md
2016-12-19 13:57:04 -08:00