Changeset 15368 for src/Pugs/Parser

Timestamp:

02/26/07 19:15:36 (21 months ago)

Author:

audreyt

Message:

* gaal++ pointed that for all non-UTF8 unicode encodings

we need to removeCRLF _after_ the decoding, not _before_.
(for UTF8 it's the same thing, so we preserve better chunkiness.)

Files:

• src/Pugs/Parser/Program.hs (modified) (1 diff)

src/Pugs/Parser/Program.hs

@@ -34 +34 @@
 decodeProgram :: String -> String
 decodeProgram str = case detectSourceEncoding str of
-    UTF8 xs                 -> decodeUTF8    (removeCRLF xs)
-    UTF16 LittleEndian xs   -> decodeUTF16LE (removeCRLF xs)
-    UTF16 BigEndian xs      -> decodeUTF16BE (removeCRLF xs)
-    UTF32 LittleEndian xs   -> decodeUTF32LE (removeCRLF xs)
-    UTF32 BigEndian xs      -> decodeUTF32BE (removeCRLF xs)
+    UTF8 xs                 -> decodeUTF8 (removeCRLF xs)
+    UTF16 LittleEndian xs   -> removeCRLF (decodeUTF16LE xs)
+    UTF16 BigEndian xs      -> removeCRLF (decodeUTF16BE xs)
+    UTF32 LittleEndian xs   -> removeCRLF (decodeUTF32LE xs)
+    UTF32 BigEndian xs      -> removeCRLF (decodeUTF32BE xs)
     where
     removeCRLF ('\r':'\n':xs)   = '\n':removeCRLF xs