https://github.com/rav009/Data-Schema-Comparison

Inspired by the AWS Glue Crawler, I used python to implement a tool which can crawl the data schema and a website which can compare the difference.
https://github.com/rav009/Data-Schema-Comparison

Last synced: 3 months ago
JSON representation

Inspired by the AWS Glue Crawler, I used python to implement a tool which can crawl the data schema and a website which can compare the difference.

• Host: GitHub
• URL: https://github.com/rav009/Data-Schema-Comparison
• Owner: rav009
• Created: 2022-03-14T02:09:07.000Z (over 3 years ago)
• Default Branch: main
• Last Pushed: 2022-03-14T02:48:26.000Z (over 3 years ago)
• Last Synced: 2024-11-27T10:36:05.987Z (10 months ago)
• Language: JavaScript
• Size: 159 KB
• Stars: 1
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

• jimsghstars - rav009/Data-Schema-Comparison - Inspired by the AWS Glue Crawler, I used python to implement a tool which can crawl the data schema and a website which can compare the difference. (JavaScript)

README

          
# Data-Schema-Comparison

Inspired by the AWS Glue Crawler, I used python to implement a crawler tool and a website interface.

* The crawler tool can catch the change of schema and store in a SQLite database.

* The website which is based on web.py and jsdiff can present the change captured.

The result of crawl was stored in a sqlite database.  

For now only Teradata is supported.  

## Dependency

### Python

* web.py

* pysqlite3

* Teradata

![alt demo](demo.jpg)