https://github.com/driftluo/data_storage
Initialize the database, import data from excel to MySQL, PostgreSQL, Oracle
https://github.com/driftluo/data_storage
pandas python3
Last synced: 3 months ago
JSON representation
Initialize the database, import data from excel to MySQL, PostgreSQL, Oracle
- Host: GitHub
- URL: https://github.com/driftluo/data_storage
- Owner: driftluo
- Created: 2017-03-16T12:39:24.000Z (over 9 years ago)
- Default Branch: master
- Last Pushed: 2017-03-18T05:51:40.000Z (over 9 years ago)
- Last Synced: 2025-04-05T02:41:42.671Z (over 1 year ago)
- Topics: pandas, python3
- Language: Python
- Size: 4.88 KB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# data_storage
Initialize the database, import data from excel to MySQL, PostgreSQL, Oracle
## main lib
- pandas
- toml
- logbook
## main function
1. Recursively search the specified path, find excel files and csv files
2. Recursively traverse all the sheets of excel and return the DataFrame. If there is a null value on the first line, it will drop it and crawl the second line is the table field, and so on.
3. Now tested, it can import Mysql/Postgresql/Oracle database. Thanks for all the pandas developers.
4. Take the sheet name as the table name.
5. But at some point, pandas to excel data to identify the error, or their own data problems, will be an error, such as timestamp object without translate attributes.