8afe2dfe37
lexer: change skip back to public interface.
2014-05-20 09:42:41 -07:00
a38524eb99
lexer/parser: rename (scan-token) to ?scan-token, (scan-datum) to ?scan-datum.
2014-05-20 09:13:58 -07:00
98abd95040
lexer: more type checking.
2014-05-20 08:53:41 -07:00
a0c5e492dd
lexer: change line-text to always be a string.
2014-05-19 14:31:08 -07:00
d3acf4d482
lexer: cleanup a bit.
2014-02-21 08:36:31 -08:00
2d9a15c7c1
lexer, parser: Rename unexpected-eof.
2013-03-23 21:35:50 -07:00
5487480126
core: cleanup USING lists.
2013-03-05 10:34:47 -08:00
8c69ea5562
lexer: typed slots.
2012-07-27 16:05:28 -07:00
4e72d80256
Using "same?" in more places.
2012-07-21 10:22:44 -07:00
2cf8b32bda
lexer: skip #! as a single token at front of line
...
Fixes #370
2011-11-27 14:59:54 -08:00
dc0a921866
Remove the lexer-factory because nothing uses it. Update usages.
2011-10-29 01:11:19 -07:00
d61de12011
Cleanup more lint warnings.
2011-10-14 12:31:46 -07:00
76580da5d5
Refactor the lexer/parser to expose friendlier words for scanning tokens. The preferred top-level words now throw an exception on EOF.
...
CREATE -> scan-new
CREATE-CLASS -> scan-new-class
CREATE-WORD -> scan-new-word
CREATE-GENERIC -> scan-new-generic
scan -> (scan-token)
scan-token now throws on eof
(scan-word) returns word/number/f
scan-word now throws on eof
scan-word-name expects a non-number
Fixes #183 .
Fixes #209 .
2011-09-29 11:28:28 -07:00
842327f3df
lexer: more clear code.
2011-09-17 08:14:13 -07:00
8a0525e5ce
Add a scan-token word which is like scan, except throws an error on EOF; document scan-object word; mention that scan-token/scan-object are preferred over scan/scan-word
2010-07-06 16:20:08 -04:00
627295f094
Language change: tuple slot setter words with stack effect ( value object -- ) are now named FOO<< instead of (>>FOO)
2010-05-06 17:21:02 -04:00
dde21c3cc4
lexer: fix output type of map-tokens
2010-03-26 16:31:48 -04:00
a566d8cc6b
lexer: each-token and map-tokens did not handle EOF properly
2010-03-26 03:42:07 -04:00
10ca2ba695
add polymorphic effects for lexer:each-token, map-tokens
2010-03-08 18:55:46 -08:00
afaaf30679
Merge branch 'lexer-parsing-word-errors'
2010-03-02 20:46:23 -08:00
9bf5c76771
lexer: add "each-token" and "map-tokens", which are equivalent to "parse-token _ each/map" but incremental. update a smattering of parsing words (such as USING:, SYMBOLS:, etc.) to use each-token/map-tokens
2010-02-28 22:19:43 -08:00
163c26ad72
lexer, parser: show initial parsing word line as part of lexer-errors
2010-02-28 13:01:03 -08:00
308d383ccd
small fix for lexer
2009-08-18 00:10:23 -05:00
3b2fd98e7c
Refactor source-file-errors a little bit to remove some code duplication, and so that clicking 'Edit' in error list tool works for parse errors in unit tests
2009-08-04 21:01:21 -05:00
cb03fe43db
Forbid tabs in source code
2009-06-16 20:49:28 +02:00
0ad6d1fb7b
add a few usages of iota, remove most 1+ and 1- from core
2009-05-01 19:58:24 -05:00
669548e62e
Clean up some usages of tuck, and add Joe's curried cleave/spread/apply combinators to kernel vocabulary
2009-02-02 13:43:54 -06:00
a4d9cdfeb3
Refactor all usages of >r/r> in core to use dip, 2dip, 3dip
...
Non-optimizing compiler now special-cases dip, 2dip, 3dip following a
literal quotation: this allows us to break the dip/slip meta-circle
without explicit calls to >r/r>
2008-11-23 02:44:56 -06:00
9628bcd646
New 'expect' word, which is a more correct version of the 'scan assert=' idiom
2008-11-22 17:27:40 -06:00
4d8f64822a
ugly accessor
2008-08-29 16:52:10 -05:00
44ad8b5f3f
new accessors
2008-08-29 16:16:43 -05:00
86f11713e3
Fixing some more bugs
2008-08-22 03:12:15 -05:00
d66f887736
Create basis vocab root
2008-07-28 22:03:13 -05:00
537269447c
Move mirrors out of the boot image
2008-07-02 00:20:01 -05:00
b36e06d0d6
Builtinn types now use new slot accessors; tuple slot type declaration work in progress
2008-06-28 02:36:20 -05:00
6e0d35e615
Split up huge parser vocabulary
2008-06-25 03:25:08 -05:00
John Benediktsson
Doug Coleman
Joe Groff
Slava Pestov
Samuel Tardieu
Doug Coleman