This is a large issue that needs to be broken out into smaller issues. The current tokenizer is quite simplistic and needs to be improved to be compliant with section 5 of this specification:
https://jakewheat.github.io/sql-overview/sql-2011-foundation-grammar.html#_5_lexical_elements
This is a large issue that needs to be broken out into smaller issues. The current tokenizer is quite simplistic and needs to be improved to be compliant with section 5 of this specification:
https://jakewheat.github.io/sql-overview/sql-2011-foundation-grammar.html#_5_lexical_elements