steve
/
factor
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity
factor/basis/io/encodings/8-bit/8-bit-tests.factor

14 lines
545 B
Factor
Raw Normal View History

io.encodings.8-bit: save 37% memory space by "compressing" codetable. Instead of a biassoc with from/to hashtables, we make a from array that is 256 length, using indexing instead of hashing since we know 8-bit characters are [0,255] and the to hashtable.
2018-02-28 13:22:13 -05:00
USING: arrays io.encodings.8-bit io.encodings.string strings
tools.test ;
More 8-bit encodings
2008-03-21 12:30:13 -04:00
io.encodings.8-bit: save 37% memory space by "compressing" codetable. Instead of a biassoc with from/to hashtables, we make a from array that is 256 length, using indexing instead of hashing since we know 8-bit characters are [0,255] and the to hashtable.
2018-02-28 13:22:13 -05:00
{ B{ CHAR: f CHAR: o CHAR: o } } [ "foo" latin2 encode ] unit-test
[ { 256 } >string latin2 encode ] must-fail
{ "bar" } [ "bar" latin2 decode ] unit-test
{ { CHAR: b 233 CHAR: r } } [ B{ CHAR: b 233 CHAR: r } latin2 decode >array ] unit-test
More 8-bit encodings
2008-03-21 12:30:13 -04:00
factor: second stab at [ ] [ ] unit-test -> { } [ ] unit-test
2015-07-03 12:39:59 -04:00
{ { 0xfffd 0x20AC } } [ B{ 0x81 0x80 } windows-1252 decode >array ] unit-test
Improve encoding API
2008-06-12 04:49:29 -04:00
io.encodings.8-bit: save 37% memory space by "compressing" codetable. Instead of a biassoc with from/to hashtables, we make a from array that is 256 length, using indexing instead of hashing since we know 8-bit characters are [0,255] and the to hashtable.
2018-02-28 13:22:13 -05:00
{ B{ 255 } } [ { 255 } >string windows-1254 encode ] unit-test
io.encodings: use new latin1 instead of 8-bit encoding from file.
2018-02-28 11:55:15 -05:00
{ { 0x221a 0x00b1 0x0040 } } [ B{ 0xfb 0xf1 0x40 } cp437 decode >array ] unit-test