steve
/
factor
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity

simple-tokenizer: whoops, need to escape \

db4
John Benediktsson 2015-04-19 21:12:40 -07:00
parent db1485b8bf
commit d235a6562e
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
basis/simple-tokenizer/simple-tokenizer.factor
View File

@ -5,7 +5,7 @@ IN: simple-tokenizer
EBNF: tokenize EBNF: tokenize
space = [ \t\n\r] space = [ \t\n\r]
escaped-char = "\" .:ch => [[ ch ]] escaped-char = "\\" .:ch => [[ ch ]]
quoted = '"' (escaped-char | [^"])*:a '"' => [[ a ]] quoted = '"' (escaped-char | [^"])*:a '"' => [[ a ]]
unquoted = (escaped-char | [^ \t\n\r"])+ unquoted = (escaped-char | [^ \t\n\r"])+
argument = (quoted | unquoted) => [[ >string ]] argument = (quoted | unquoted) => [[ >string ]]