steve
/
factor
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity
factor/basis/json/reader/reader-tests.factor

89 lines
3.2 KiB
Factor
Raw Normal View History

json.reader: fix segfault when parsing non-JSON documents.
2015-07-28 21:10:24 -04:00
USING: hashtables io.streams.string json json.reader
json.reader.private kernel literals math strings tools.test ;
Add a test suite for json.reader. Fix bugs in json.reader: failure to parse when more than one character of whitespace between tokens, failure to parse escape codes in strings, misinterpretation of "e+02" as a negative exponent, failure to handle leading whitespace, and failure to handle "+" as the first character of a number. Change json.reader to parse JSON booleans into Factor t and f, and to parse JSON null into the json-null symbol.
2008-05-31 01:46:15 -04:00
IN: json.reader.tests
{ f } [ "false" json> ] unit-test
{ t } [ "true" json> ] unit-test
{ json-null } [ "null" json> ] unit-test
{ 0 } [ "0" json> ] unit-test
Import a few extra JSON tests from Jansson Fixes #1189
2016-03-05 09:56:18 -05:00
{ 0 } [ "-0" json> ] unit-test
Add a test suite for json.reader. Fix bugs in json.reader: failure to parse when more than one character of whitespace between tokens, failure to parse escape codes in strings, misinterpretation of "e+02" as a negative exponent, failure to handle leading whitespace, and failure to handle "+" as the first character of a number. Change json.reader to parse JSON booleans into Factor t and f, and to parse JSON null into the json-null symbol.
2008-05-31 01:46:15 -04:00
{ 102 } [ "102" json> ] unit-test
{ -102 } [ "-102" json> ] unit-test
{ 102 } [ "+102" json> ] unit-test
Refactored json.reader, added a couple more unit tests, no more rationals
2008-11-07 23:00:19 -05:00
{ 1000.0 } [ "1.0e3" json> ] unit-test
{ 1000.0 } [ "10e2" json> ] unit-test
Add a test suite for json.reader. Fix bugs in json.reader: failure to parse when more than one character of whitespace between tokens, failure to parse escape codes in strings, misinterpretation of "e+02" as a negative exponent, failure to handle leading whitespace, and failure to handle "+" as the first character of a number. Change json.reader to parse JSON booleans into Factor t and f, and to parse JSON null into the json-null symbol.
2008-05-31 01:46:15 -04:00
{ 102.0 } [ "102.0" json> ] unit-test
{ 102.5 } [ "102.5" json> ] unit-test
{ 102.5 } [ "102.50" json> ] unit-test
floating point test fix
2008-09-02 16:09:14 -04:00
{ -10250.0 } [ "-102.5e2" json> ] unit-test
{ -10250.0 } [ "-102.5E+2" json> ] unit-test
Import a few extra JSON tests from Jansson Fixes #1189
2016-03-05 09:56:18 -05:00
{ -1.025 } [ "-102.5E-2" json> ] unit-test
Refactored json.reader, added a couple more unit tests, no more rationals
2008-11-07 23:00:19 -05:00
{ 10.25 } [ "1025e-2" json> ] unit-test
Adjust json.reader unit tests a bit
2008-05-31 12:10:11 -04:00
{ 0.125 } [ "0.125" json> ] unit-test
{ -0.125 } [ "-0.125" json> ] unit-test
Add a hand parser. Improves speed from 23 seconds to 0.03 seconds when parsing a 123Kb string.
2009-05-29 17:41:24 -04:00
{ -0.00125 } [ "-0.125e-2" json> ] unit-test
{ -012.5 } [ "-0.125e+2" json> ] unit-test
Import a few extra JSON tests from Jansson Fixes #1189
2016-03-05 09:56:18 -05:00
{ 0.0 } [ "123e-10000000" json> ] unit-test
Add a test suite for json.reader. Fix bugs in json.reader: failure to parse when more than one character of whitespace between tokens, failure to parse escape codes in strings, misinterpretation of "e+02" as a negative exponent, failure to handle leading whitespace, and failure to handle "+" as the first character of a number. Change json.reader to parse JSON booleans into Factor t and f, and to parse JSON null into the json-null symbol.
2008-05-31 01:46:15 -04:00
A bit more refactoring and testing of json.reader
2008-11-08 15:08:58 -05:00
! not widely supported by javascript, but allowed in the grammar, and a nice
! feature to get
{ -0.0 } [ "-0.0" json> ] unit-test
factor: remove """ string syntax for now. there are HEREDOC:, STRING:, escaping \", and something else soon.
2015-07-26 01:59:56 -04:00
{ " fuzzy pickles " } [ " \" fuzzy pickles \" " json> ] unit-test
{ "while 1:\n\tpass" } [ " \"while 1:\n\tpass\" " json> ] unit-test
A bit more refactoring and testing of json.reader
2008-11-08 15:08:58 -05:00
! unicode is allowed in json
factor: remove """ string syntax for now. there are HEREDOC:, STRING:, escaping \", and something else soon.
2015-07-26 01:59:56 -04:00
{ "ß∂¬ƒ˚∆" } [ " \"ß∂¬ƒ˚∆\"" json> ] unit-test
${ { 8 9 10 12 13 34 47 92 } >string } [ " \"\\b\\t\\n\\f\\r\\\"\\/\\\\\" " json> ] unit-test
${ { 0xabcd } >string } [ " \"\\uaBCd\" " json> ] unit-test
json.reader: read UTF-16 surrogate pairs
2015-06-10 18:25:19 -04:00
{ "𝄞" } [ "\"\\ud834\\udd1e\"" json> ] unit-test
Add a test suite for json.reader. Fix bugs in json.reader: failure to parse when more than one character of whitespace between tokens, failure to parse escape codes in strings, misinterpretation of "e+02" as a negative exponent, failure to handle leading whitespace, and failure to handle "+" as the first character of a number. Change json.reader to parse JSON booleans into Factor t and f, and to parse JSON null into the json-null symbol.
2008-05-31 01:46:15 -04:00
Fix a error parsing out nested arrays.
2009-06-06 23:49:44 -04:00
{ H{ { "a" { } } { "b" 123 } } } [ "{\"a\":[],\"b\":123}" json> ] unit-test
factor: clean up spaces in -tests files
2015-07-02 13:34:01 -04:00
{ { } } [ "[]" json> ] unit-test
factor: remove """ string syntax for now. there are HEREDOC:, STRING:, escaping \", and something else soon.
2015-07-26 01:59:56 -04:00
{ { 1 "two" 3.0 } } [ " [1, \"two\", 3.0] " json> ] unit-test
Refactored json.reader, added a couple more unit tests, no more rationals
2008-11-07 23:00:19 -05:00
{ H{ } } [ "{}" json> ] unit-test
A bit more refactoring and testing of json.reader
2008-11-08 15:08:58 -05:00
! the returned hashtable should be different every time
swap drop === nip
2008-11-08 16:45:45 -05:00
{ H{ } } [ "key" "value" "{}" json> ?set-at "{}" json> nip ] unit-test
A bit more refactoring and testing of json.reader
2008-11-08 15:08:58 -05:00
factor: remove """ string syntax for now. there are HEREDOC:, STRING:, escaping \", and something else soon.
2015-07-26 01:59:56 -04:00
{ H{ { "US$" 1.0 } { "EU€" 1.5 } } } [ " { \"US$\":1.00, \"EU\\u20AC\":1.50 } " json> ] unit-test
Add a test suite for json.reader. Fix bugs in json.reader: failure to parse when more than one character of whitespace between tokens, failure to parse escape codes in strings, misinterpretation of "e+02" as a negative exponent, failure to handle leading whitespace, and failure to handle "+" as the first character of a number. Change json.reader to parse JSON booleans into Factor t and f, and to parse JSON null into the json-null symbol.
2008-05-31 01:46:15 -04:00
{ H{
{ "fib" { 1 1 2 3 5 8 H{ { "etc" "etc" } } } }
{ "prime" { 2 3 5 7 11 13 } }
factor: remove """ string syntax for now. there are HEREDOC:, STRING:, escaping \", and something else soon.
2015-07-26 01:59:56 -04:00
} } [ " {
\"fib\": [1, 1, 2, 3, 5, 8,
{ \"etc\":\"etc\" } ],
\"prime\":
Add a test suite for json.reader. Fix bugs in json.reader: failure to parse when more than one character of whitespace between tokens, failure to parse escape codes in strings, misinterpretation of "e+02" as a negative exponent, failure to handle leading whitespace, and failure to handle "+" as the first character of a number. Change json.reader to parse JSON booleans into Factor t and f, and to parse JSON null into the json-null symbol.
2008-05-31 01:46:15 -04:00
[ 2,3, 5,7,
11,
13
] }
factor: remove """ string syntax for now. there are HEREDOC:, STRING:, escaping \", and something else soon.
2015-07-26 01:59:56 -04:00
" json> ] unit-test
Add a test suite for json.reader. Fix bugs in json.reader: failure to parse when more than one character of whitespace between tokens, failure to parse escape codes in strings, misinterpretation of "e+02" as a negative exponent, failure to handle leading whitespace, and failure to handle "+" as the first character of a number. Change json.reader to parse JSON booleans into Factor t and f, and to parse JSON null into the json-null symbol.
2008-05-31 01:46:15 -04:00
{ 0 } [ " 0" json> ] unit-test
{ 0 } [ "0 " json> ] unit-test
{ 0 } [ " 0 " json> ] unit-test
json reader: correctly handle empty objects in objects Attempting to parse { "foo" : {} } previously resulted in an error. (close-hash) expected to consolidate an object into the values of the containing object (in the first line of code). While there is none in the case of the empty hash, the structure of the accumulator looked like it contained an unconsolidated object, so it folded the values into the keys and got very confused.
2009-12-24 18:48:16 -05:00
json.reader: factor read-jsons from json>
2010-06-03 16:11:47 -04:00
{ V{ H{ { "a" "b" } } H{ { "c" "d" } } } }
json.reader: Fix json reader for empty files to parse as H{ }. Add path>json word. Rename read-jsons
2015-08-03 15:23:08 -04:00
[ "{\"a\": \"b\"} {\"c\": \"d\"}" [ read-json-objects ] with-string-reader ] unit-test
json.reader: factor read-jsons from json>
2010-06-03 16:11:47 -04:00
json reader: correctly handle empty objects in objects Attempting to parse { "foo" : {} } previously resulted in an error. (close-hash) expected to consolidate an object into the values of the containing object (in the first line of code). While there is none in the case of the empty hash, the structure of the accumulator looked like it contained an unconsolidated object, so it folded the values into the keys and got very confused.
2009-12-24 18:48:16 -05:00
! empty objects are allowed as values in objects
{ H{ { "foo" H{ } } } } [ "{ \"foo\" : {}}" json> ] unit-test
Import a few extra JSON tests from Jansson Fixes #1189
2016-03-05 09:56:18 -05:00
! And arrays
{ { H{ } } } [ "[{}]" json> ] unit-test
json: better support for escaped strings.
2014-11-27 17:52:18 -05:00
{
"\0\x01\x02\x03\x04\x05\x06\a\b\t\n\v\f\r\x0e\x0f\x10\x11\x12\x13\x14\x15\x16\x17\x18\x19\x1a\e\x1c\x1d\x1e\x1f"
} [
"\"\\u0000\\u0001\\u0002\\u0003\\u0004\\u0005\\u0006\\u0007\\b\\t\\n\\u000b\\f\\r\\u000e\\u000f\\u0010\\u0011\\u0012\\u0013\\u0014\\u0015\\u0016\\u0017\\u0018\\u0019\\u001a\\u001b\\u001c\\u001d\\u001e\\u001f\""
json>
] unit-test
json.reader: read Infinity, -Infinity and NaN
2015-06-10 18:46:56 -04:00
{ 1/0. } [ "Infinity" json> ] unit-test
{ -1/0. } [ "-Infinity" json> ] unit-test
{ t } [ "NaN" json> fp-nan? ] unit-test
json.reader: fix segfault when parsing non-JSON documents.
2015-07-28 21:10:24 -04:00
[ "<!doctype html>\n<html>\n<head>\n " json> ]
[ not-a-json-number? ] must-fail-with
json.reader: Fix json reader for empty files to parse as H{ }. Add path>json word. Rename read-jsons
2015-08-03 15:23:08 -04:00
{ H{ } } [ "" json> ] unit-test