Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/taozhi8833998/node-sql-parser
Parse simple SQL statements into an abstract syntax tree (AST) with the visited tableList and convert it back to SQL
https://github.com/taozhi8833998/node-sql-parser
Last synced: about 1 month ago
JSON representation
Parse simple SQL statements into an abstract syntax tree (AST) with the visited tableList and convert it back to SQL
- Host: GitHub
- URL: https://github.com/taozhi8833998/node-sql-parser
- Owner: taozhi8833998
- License: apache-2.0
- Created: 2018-12-18T09:09:06.000Z (almost 6 years ago)
- Default Branch: master
- Last Pushed: 2024-10-12T00:57:59.000Z (2 months ago)
- Last Synced: 2024-10-12T02:33:15.052Z (2 months ago)
- Language: PEG.js
- Homepage: https://taozhi8833998.github.io/node-sql-parser/
- Size: 14.1 MB
- Stars: 800
- Watchers: 12
- Forks: 180
- Open Issues: 40
-
Metadata Files:
- Readme: README.md
- Funding: .github/FUNDING.yml
- License: LICENSE
Awesome Lists containing this project
- awesome - taozhi8833998/node-sql-parser - Parse simple SQL statements into an abstract syntax tree (AST) with the visited tableList and convert it back to SQL (PEG.js)
- awesome-github-star - node-sql-parser
README
# Nodejs SQL Parser
[](https://travis-ci.org/taozhi8833998/node-sql-parser)
[](https://www.codacy.com/manual/taozhi8833998/node-sql-parser?utm_source=github.com&utm_medium=referral&utm_content=taozhi8833998/node-sql-parser&utm_campaign=Badge_Grade)
[](https://coveralls.io/github/taozhi8833998/node-sql-parser?branch=master)
[](https://img.shields.io/david/taozhi8833998/node-sql-parser)
[](https://snyk.io/test/github/taozhi8833998/node-sql-parser?targetFile=package.json)
[](https://github.com/taozhi8833998/node-sql-parser)
[](https://badge.fury.io/js/node-sql-parser)
[](http://www.npmtrends.com/node-sql-parser)
[](https://gitter.im/node-sql-parser/community)
[](https://github.com/taozhi8833998/node-sql-parser/issues)
[](http://definitelytyped.org)
[](https://github.com/taozhi8833998/node-sql-parser/blob/master/LICENSE)
**Parse simple SQL statements into an abstract syntax tree (AST) with the visited tableList, columnList and convert it back to SQL.**
## :star: Features
- support multiple sql statement seperate by semicolon
- support select, delete, update and insert type
- support drop, truncate and rename command
- output the table and column list that the sql visited with the corresponding authority
- support various databases engine
## :tada: Install
### From [npmjs](https://www.npmjs.org/)
```bash
npm install node-sql-parser --save
or
yarn add node-sql-parser
```
### From [GitHub Package Registry](https://npm.pkg.github.com/)
```bash
npm install @taozhi8833998/node-sql-parser --registry=https://npm.pkg.github.com/
```
### From Browser
Import the JS file in your page:
```javascript
// support all database parser, but file size is about 750K
// or you can import specified database parser only, it's about 150K
```
- `NodeSQLParser` object is on `window`
```html
node-sql-parser
Check console to see the output
window.onload = function () {
// Example parser
const parser = new NodeSQLParser.Parser()
const ast = parser.astify("select id, name from students where age < 18")
console.log(ast)
const sql = parser.sqlify(ast)
console.log(sql)
}
```
## :rocket: Usage
### Supported Database SQL Syntax
- Athena
- BigQuery
- DB2
- Hive
- MariaDB
- MySQL
- PostgresQL
- Redshift
- Sqlite
- TransactSQL
- [FlinkSQL](https://ci.apache.org/projects/flink/flink-docs-stable/dev/table/sql/)
- Snowflake(alpha)
- [Noql](https://noql.synatic.dev/)
- New issue could be made for other new database.
### Create AST for SQL statement
```javascript
// import Parser for all databases
const { Parser } = require('node-sql-parser');
const parser = new Parser();
const ast = parser.astify('SELECT * FROM t'); // mysql sql grammer parsed by default
console.log(ast);
```
- `ast` for `SELECT * FROM t`
```json
{
"with": null,
"type": "select",
"options": null,
"distinct": null,
"columns": "*",
"from": [
{
"db": null,
"table": "t",
"as": null
}
],
"where": null,
"groupby": null,
"having": null,
"orderby": null,
"limit": null
}
```
#### Get node location in the AST
```javascript
const { Parser } = require('node-sql-parser');
const parser = new Parser();
const ast = parser.astify('SELECT * FROM t', { parseOptions: { includeLocations: true } });
console.log(ast);
```
- `ast` for `SELECT * FROM t` with the `loc` property indicating locations and ranges
```json
{
"with": null,
"type": "select",
"options": null,
"distinct": null,
"columns": [
{
"expr": {
"type": "column_ref",
"table": null,
"column": "*"
},
"as": null,
"loc": {
"start": {
"offset": 7,
"line": 1,
"column": 8
},
"end": {
"offset": 8,
"line": 1,
"column": 9
}
}
}
],
"into": {
"position": null
},
"from": [
{
"db": null,
"table": "t",
"as": null,
"loc": {
"start": {
"offset": 14,
"line": 1,
"column": 15
},
"end": {
"offset": 15,
"line": 1,
"column": 16
}
}
}
],
"where": null,
"groupby": null,
"having": null,
"orderby": null,
"limit": null,
"locking_read": null,
"window": null,
"loc": {
"start": {
"offset": 0,
"line": 1,
"column": 1
},
"end": {
"offset": 15,
"line": 1,
"column": 16
}
}
}
```
### Convert AST back to SQL
```javascript
const opt = {
database: 'MySQL' // MySQL is the default database
}
// import mysql parser only
const { Parser } = require('node-sql-parser');
const parser = new Parser()
// opt is optional
const ast = parser.astify('SELECT * FROM t', opt);
const sql = parser.sqlify(ast, opt);
console.log(sql); // SELECT * FROM `t`
```
### Parse specified Database
There two ways to parser the specified database.
import Parser from the specified database path `node-sql-parser/build/{database}`
```javascript
// import transactsql parser only
const { Parser } = require('node-sql-parser/build/transactsql')
const parser = new Parser()
const sql = `SELECT id FROM test AS result`
const ast = parser.astify(sql)
console.log(parser.sqlify(ast)) // SELECT [id] FROM [test] AS [result]
```
OR you can pass a options object to the parser, and specify the database property.
```javascript
const opt = {
database: 'Postgresql'
}
// import all databases parser
const { Parser } = require('node-sql-parser')
const parser = new Parser()
// pass the opt config to the corresponding methods
const ast = parser.astify('SELECT * FROM t', opt)
const sql = parser.sqlify(ast, opt)
console.log(sql); // SELECT * FROM "t"
```
### Get TableList, ColumnList, Ast by `parse` function
```javascript
const opt = {
database: 'MariaDB' // MySQL is the default database
}
const { Parser } = require('node-sql-parser/build/mariadb');
const parser = new Parser()
// opt is optional
const { tableList, columnList, ast } = parser.parse('SELECT * FROM t', opt);
```
### Get the SQL visited tables
- get the table list that the sql visited
- the format is **{type}::{dbName}::{tableName}** // type could be select, update, delete or insert
```javascript
const opt = {
database: 'MySQL'
}
const { Parser } = require('node-sql-parser/build/mysql');
const parser = new Parser();
// opt is optional
const tableList = parser.tableList('SELECT * FROM t', opt);
console.log(tableList); // ["select::null::t"]
```
- if the table name is prefixed with database name, the table name will be parsed as **dbName::tableName**
- if the table name is prefixed with database and schema name, the table name will be parsed as **dbName.schemaName::tableName**
- if the table name is prefixed with server name in TransactSQL, the table name will be parsed as **serverName.dbName.schemaName::tableName**
### Get the SQL visited columns
- get the column list that the sql visited
- the format is **{type}::{tableName}::{columnName}** // type could be select, update, delete or insert
- for `select *`, `delete` and `insert into tableName values()` without specified columns, the `.*` column authority regex is required
```javascript
const opt = {
database: 'MySQL'
}
const { Parser } = require('node-sql-parser/build/mysql');
const parser = new Parser();
// opt is optional
const columnList = parser.columnList('SELECT t.id FROM t', opt);
console.log(columnList); // ["select::t::id"]
```
### Check the SQL with Authority List
- check table authority
- `whiteListCheck` function check on `table` mode and `MySQL` database by default
```javascript
const { Parser } = require('node-sql-parser');
const parser = new Parser();
const sql = 'UPDATE a SET id = 1 WHERE name IN (SELECT name FROM b)'
const whiteTableList = ['(select|update)::(.*)::(a|b)'] // array that contain multiple authorities
const opt = {
database: 'MySQL',
type: 'table',
}
// opt is optional
parser.whiteListCheck(sql, whiteTableList, opt) // if check failed, an error would be thrown with relevant error message, if passed it would return undefined
```
- check column authority
```javascript
const { Parser } = require('node-sql-parser');
const parser = new Parser();
const sql = 'UPDATE a SET id = 1 WHERE name IN (SELECT name FROM b)'
const whiteColumnList = ['select::null::name', 'update::a::id'] // array that contain multiple authorities
const opt = {
database: 'MySQL',
type: 'column',
}
// opt is optional
parser.whiteListCheck(sql, whiteColumnList, opt) // if check failed, an error would be thrown with relevant error message, if passed it would return undefined
```
## :kissing_heart: Acknowledgement
This project is inspired by the SQL parser [flora-sql-parser](https://github.com/godmodelabs/flora-sql-parser) module.
## License
[Apache-2.0](LICENSE)
## Buy me a Coffee
If you like my project, **Star** in the corresponding project right corner. Your support is my biggest encouragement! ^_^
You can also scan the qr code below or open paypal link to donate to Author.
### Paypal
Donate money by [paypal](https://www.paypal.me/taozhi8833998/5) to my account [[email protected]]([email protected])
### AliPay(支付宝)
### Wechat(微信)
### Explain
If you have made a donation, you can leave your name and email in the issue, your name will be written to the donation list.
## [Donation list](https://github.com/taozhi8833998/node-sql-parser/blob/master/DONATIONLIST.md)
## Star History
