{"id":26537008,"url":"https://github.com/sankethsj/py-etl","last_synced_at":"2026-04-18T15:36:46.366Z","repository":{"id":282552918,"uuid":"948959698","full_name":"sankethsj/py-etl","owner":"sankethsj","description":"A simple ETL tool that allows users to upload an Excel or CSV file, preview the data, analyze it, and load it into a PostgreSQL database.","archived":false,"fork":false,"pushed_at":"2025-03-15T11:08:16.000Z","size":4,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-06-15T22:06:46.207Z","etag":null,"topics":["etl","python","streamlit"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/sankethsj.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2025-03-15T11:01:18.000Z","updated_at":"2025-03-15T11:08:19.000Z","dependencies_parsed_at":"2025-03-15T18:30:26.015Z","dependency_job_id":null,"html_url":"https://github.com/sankethsj/py-etl","commit_stats":null,"previous_names":["sankethsj/py-etl"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/sankethsj/py-etl","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sankethsj%2Fpy-etl","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sankethsj%2Fpy-etl/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sankethsj%2Fpy-etl/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sankethsj%2Fpy-etl/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/sankethsj","download_url":"https://codeload.github.com/sankethsj/py-etl/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sankethsj%2Fpy-etl/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":31974946,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-18T00:39:45.007Z","status":"online","status_checked_at":"2026-04-18T02:00:07.018Z","response_time":103,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["etl","python","streamlit"],"created_at":"2025-03-21T22:17:58.530Z","updated_at":"2026-04-18T15:36:46.327Z","avatar_url":"https://github.com/sankethsj.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Py-ETL\n\nPy-ETL is a simple ETL (Extract, Transform, Load) tool that allows users to upload an Excel or CSV file, preview the data, analyze it, and load it into a PostgreSQL database.\n\n## Features\n\n- Upload Excel or CSV files\n- Preview the uploaded data\n- Analyze the data (missing values, basic statistics)\n- Connect to a PostgreSQL database\n- Select schema and table from the database\n- Load data into the selected table\n\n## Installation\n\n1. Clone the repository:\n    ```sh\n    git clone https://github.com/sankethsj/py-etl.git\n    cd py-etl\n    ```\n\n2. Create a virtual environment and activate it:\n    ```sh\n    python -m venv venv\n    source venv/bin/activate  # On Windows use `venv\\Scripts\\activate`\n    ```\n\n3. Install the required packages:\n    ```sh\n    pip install -r requirements.txt\n    ```\n\n## Usage\n\n1. Run the Streamlit app:\n    ```sh\n    streamlit run app.py\n    ```\n\n2. Open your web browser and go to `http://localhost:8501`.\n\n3. Follow the steps in the app:\n    - Upload an Excel or CSV file.\n    - Preview and analyze the data.\n    - Enter the database connection details and connect to the database.\n    - Select the schema and table.\n    - Load the data into the selected table.\n\n## Contributing\n\nContributions are welcome! Please open an issue or submit a pull request for any improvements or bug fixes.\n\n## License\n\nThis project is licensed under the MIT License. See the [LICENSE](LICENSE) file for details.\n\n## Acknowledgements\n\n- [Streamlit](https://streamlit.io/)\n- [Pandas](https://pandas.pydata.org/)\n- [SQLAlchemy](https://www.sqlalchemy.org/)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsankethsj%2Fpy-etl","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fsankethsj%2Fpy-etl","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsankethsj%2Fpy-etl/lists"}