Repository navigation
support MySQL special character escape sequences #23
Description
Hi!
Thank you for this great library.
I am trying to use it to parse wikipedia dumps in my project wikipedia-externallinks-fast-extraction.
Unfortunately, they contain mysql escape characters that are currently not supported by this library.
Unsupported characters
The escape characters are:
\0
\'
\"
\b
\n
\r
\t
\Z
\\
\%
\_
Example
INSERT INTO externallinks VALUES (23481,120102,'http://home.arcor.de/jean-polmartin/aufsaetze/apliut.htm\'','http://de.arcor.home./jean-polmartin/aufsaetze/apliut.htm\'','http://de.arcor.home./jean-polmartin/aufsaetze/apliut.htm\'');
Activity
lovasoa commentedon Sep 14, 2018
SQLite escape sequences don't seem to be supported either. According to the README:
So I think :
''''should parse as'(sqlite-only)'\'should parse as\(sqlite-only)'\\'should parse as\\(it is a valid string in both SQLite and mysql, but with a different meaning)'\''should parse as'(mysql-only)lovasoa commentedon Sep 14, 2018
It should not be difficult to implement using
nom::escaped_transformms705 commentedon Sep 14, 2018
Good catch -- I actually independently ran into this issue last week (also parsing MySQL dumps) and made a mental note to fix it!
I originally looked at
nom::escaped_transformfor this, but didn't yet figure out exactly how to use it for this purpose. Looks like you ended up hand-rolling the parse rule instead, probably for good reasons.I'll check out the PR 👍
lovasoa commentedon Sep 16, 2018
I also tried to use
nom::escaped_transformbut with no success. I think this is because of that part of the documentation:Implement the remaining mysql string escape code
ms705 commentedon Oct 3, 2018
I think we have all of them supported now, thanks to @lovasoa's work 👍