steve
/
factor
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity

Add \r to whitespace in javascript tokenizer

db4
Chris Double 2008-06-18 23:50:25 +12:00
parent fea65df1df
commit ea6974d5da
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
extra/peg/javascript/javascript.factor
View File

@ -52,7 +52,7 @@ Digit = [0-9]
Digits = Digit+ Digits = Digit+
SingleLineComment = "//" (!("\n") .)* "\n" => [[ ignore ]] SingleLineComment = "//" (!("\n") .)* "\n" => [[ ignore ]]
MultiLineComment = "/*" (!("*/") .)* "*/" => [[ ignore ]] MultiLineComment = "/*" (!("*/") .)* "*/" => [[ ignore ]]
Space = " " | "\t" | "\n" | SingleLineComment | MultiLineComment Space = " " | "\t" | "\r" | "\n" | SingleLineComment | MultiLineComment
Spaces = Space* => [[ ignore ]] Spaces = Space* => [[ ignore ]]
NameFirst = Letter | "$" | "_" NameFirst = Letter | "$" | "_"
NameRest = NameFirst | Digit NameRest = NameFirst | Digit