b2de82042c
io.encodings.8-bit: adding KZ-1048 and KOI8-U.
2018-03-02 16:09:21 -08:00
6d2abd0122
io.encodings.8-bit: adding cp424.
2018-03-01 10:48:08 -08:00
6d1bb9e1ba
io.encodings.8-bit: reimplement M\ 8-bit encode-string.
2018-02-28 10:35:33 -08:00
1b3a07ca44
io.encodings.8-bit: save 37% memory space by "compressing" codetable.
...
Instead of a biassoc with from/to hashtables, we make a from array that
is 256 length, using indexing instead of hashing since we know 8-bit
characters are [0,255] and the to hashtable.
2018-02-28 10:22:13 -08:00
0ab7ed6979
io.encodings: use new latin1 instead of 8-bit encoding from file.
2018-02-28 08:56:01 -08:00
ca2612b906
io.encodings.8-bit: simplify by not implementing encode-string.
2018-02-26 15:19:53 -08:00
b74e8d3c22
Revert "io.encodings.8-bit: adding CP874."
...
This reverts commit 9cccb4de95
2018-02-26 12:30:11 -08:00
9cccb4de95
io.encodings.8-bit: adding CP874.
2018-02-26 11:45:11 -08:00
85b69b5b49
io.encodings.8-bit: more encodings, and reduce hierarchy.
2018-02-26 10:21:35 -08:00
f342fd04d9
simple-flat-file: rename flat-file>biassoc to load-codetable-file.
2017-02-03 11:47:28 -08:00
ceb75057da
change ERROR: words from throw-foo back to foo.
2015-08-13 16:13:05 -07:00
02008979d9
factor: Change ERROR: foo ; to define ``throw-foo`` instead of having ``foo`` throw implicitly. The old ``foo`` still throws implicitly because this is a big change to get right in one patch, but it should be removed soon.
2015-08-12 15:26:18 -05:00
6e60c811ac
core: Rename create to create-word, create-in to create-word-in.
2015-06-08 12:47:35 -07:00
76580da5d5
Refactor the lexer/parser to expose friendlier words for scanning tokens. The preferred top-level words now throw an exception on EOF.
...
CREATE -> scan-new
CREATE-CLASS -> scan-new-class
CREATE-WORD -> scan-new-word
CREATE-GENERIC -> scan-new-generic
scan -> (scan-token)
scan-token now throws on eof
(scan-word) returns word/number/f
scan-word now throws on eof
scan-word-name expects a non-number
Fixes #183 .
Fixes #209 .
2011-09-29 11:28:28 -07:00
2eda6fc6aa
io.encodings: add a fast-path for ascii, utf8 and 8-bit encodings when string only contains ASCII characters
2010-04-19 01:14:00 -05:00
1ff1e3f4bc
add docs to 8-bit encodings vocabs, update usages
2009-11-12 18:36:20 -06:00
b7745fea3c
add new 8-BIT: word
2009-11-12 16:38:21 -06:00
42fc3c0f05
Add support for CP-1250 encoding
2009-11-05 07:35:16 +01:00
8c61791364
Big5 encoding; simple-flat-file vocab abstracts parsing out; EUC code factored out; Asian encoding vocabs renamed
...
Merge branch 'master' of git://github.com/ageldama/factor
Conflicts:
basis/io/encodings/korean/korean-docs.factor
basis/io/encodings/korean/korean-tests.factor
basis/io/encodings/korean/korean.factor
2009-03-02 23:19:06 -06:00
eaad0c7660
Updating code to use CONSTANT: instead of : foo 123 ; inline
2009-02-23 21:40:17 -06:00
ebd0e9250f
Clean up some <file-reader> usages to use file-lines, file>csv, and file>xml instead
2009-02-15 20:45:06 -06:00
6b99b04531
Add vocab: for vocab-relative paths
2009-02-15 19:53:21 -06:00
246c4bb13c
Fixing encodings/XML
2009-02-03 17:32:05 -06:00
3c75dfd2e0
Shift-JIS support; minor cleanup of io.binary
2009-02-01 23:47:36 -06:00
92141af349
Get mason to load
2008-12-17 18:22:48 -06:00
c19f2257f4
Fix permission bits
2008-10-02 08:34:49 -05:00
40e926609a
Fixing unit tests
2008-08-22 22:07:59 -05:00
d66f887736
Create basis vocab root
2008-07-28 22:03:13 -05:00
John Benediktsson
Doug Coleman
Slava Pestov
carlok
Daniel Ehrenberg
Daniel Ehrenberg
Daniel Ehrenberg