steve
/
factor
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity
factor/core/io/utf8/utf8-tests.factor

17 lines
907 B
Factor
Raw Normal View History

Fixing UTF-8 to put the replacement character for malformed stuff
2008-02-01 23:50:30 -05:00
USING: io.utf8 tools.test strings arrays unicode.syntax ;
Initial import
2007-09-20 18:09:08 -04:00
Fixing UTF-8 to put the replacement character for malformed stuff
2008-02-01 23:50:30 -05:00
[ { UNICHAR: replacement-character } ] [ { BIN: 11110101 BIN: 10111111 BIN: 10000000 BIN: 11111111 } decode-utf8 >array ] unit-test
Initial import
2007-09-20 18:09:08 -04:00
Fixing UTF-8 to put the replacement character for malformed stuff
2008-02-01 23:50:30 -05:00
[ { BIN: 101111111000000111111 } ] [ { BIN: 11110101 BIN: 10111111 BIN: 10000000 BIN: 10111111 } decode-utf8 >array ] unit-test
Initial import
2007-09-20 18:09:08 -04:00
[ "x" ] [ "x" decode-utf8 >string ] unit-test
Fixing UTF-8 to put the replacement character for malformed stuff
2008-02-01 23:50:30 -05:00
[ { BIN: 11111000000 } ] [ { BIN: 11011111 BIN: 10000000 } decode-utf8 >array ] unit-test
Initial import
2007-09-20 18:09:08 -04:00
Fixing UTF-8 to put the replacement character for malformed stuff
2008-02-01 23:50:30 -05:00
[ { UNICHAR: replacement-character } ] [ { BIN: 10000000 } decode-utf8 >array ] unit-test
Initial import
2007-09-20 18:09:08 -04:00
Fixing UTF-8 to put the replacement character for malformed stuff
2008-02-01 23:50:30 -05:00
[ { BIN: 1111000000111111 } ] [ { BIN: 11101111 BIN: 10000000 BIN: 10111111 } decode-utf8 >array ] unit-test
Initial import
2007-09-20 18:09:08 -04:00
[ B{ BIN: 11110101 BIN: 10111111 BIN: 10000000 BIN: 10111111 BIN: 11101111 BIN: 10000000 BIN: 10111111 BIN: 11011111 BIN: 10000000 CHAR: x } ]
[ { BIN: 101111111000000111111 BIN: 1111000000111111 BIN: 11111000000 CHAR: x } encode-utf8 ] unit-test