{"id":20215469,"url":"https://github.com/alefrp/text_to_db","last_synced_at":"2026-04-11T02:49:47.138Z","repository":{"id":206051006,"uuid":"715699670","full_name":"AlefRP/text_to_db","owner":"AlefRP","description":"A Python tool for efficiently converting CSV data into a PostgreSQL database, featuring column name translation and error logging.","archived":false,"fork":false,"pushed_at":"2024-01-24T16:18:37.000Z","size":3440,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-06-04T04:22:12.217Z","etag":null,"topics":["converter","database","postgresql","python"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/AlefRP.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-11-07T16:52:24.000Z","updated_at":"2024-02-23T11:06:31.000Z","dependencies_parsed_at":null,"dependency_job_id":"59b0fc34-944d-4eab-ad47-0999668be5d0","html_url":"https://github.com/AlefRP/text_to_db","commit_stats":null,"previous_names":["alefrp/text_to_db"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/AlefRP/text_to_db","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AlefRP%2Ftext_to_db","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AlefRP%2Ftext_to_db/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AlefRP%2Ftext_to_db/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AlefRP%2Ftext_to_db/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/AlefRP","download_url":"https://codeload.github.com/AlefRP/text_to_db/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/AlefRP%2Ftext_to_db/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":266785532,"owners_count":23983829,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-07-24T02:00:09.469Z","response_time":99,"last_error":null,"robots_txt_status":null,"robots_txt_updated_at":null,"robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["converter","database","postgresql","python"],"created_at":"2024-11-14T06:22:32.421Z","updated_at":"2026-04-11T02:49:42.119Z","avatar_url":"https://github.com/AlefRP.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Text To DB Converter\r\n\r\n## Overview 📈\r\n\r\nThis utility is designed to process CSV files containing tax data, translate the column names based on a provided dictionary, and then load the processed data into a PostgreSQL database. If errors occur during processing, the problematic files are recorded in an `error-log.csv` for subsequent review.\r\n\r\n\u003cimg src=\"https://github.com/AlefRP/text_to_db/blob/main/images/TextToDBConverter.png\" style=\"max-width: 100%; height: auto; border-radius: 10px;\" alt=\"Overview of Text To DB Converter\"\u003e\r\n\r\n## Requirements 🐍\r\n\r\n- Python 3.11.5\r\n- Libraries: `pandas`, `sqlalchemy`, `csv`, `os`, `shutil`, `tqdm`\r\n\r\n## Configuration ⚙️\r\n\r\n1. Database credentials should be set up in the `config_db.py` file:\r\n\r\n   ```python\r\n   db_username = 'your_username'\r\n   db_password = 'your_password'\r\n   db_host = 'db_host'\r\n   db_port = 'db_port'\r\n   db_name = 'db_name'\r\n   db_schema = 'test'\r\n   ```\r\n\r\n2. Ensure that the PostgreSQL database is running and that the credentials provided in the `config_db.py` file are correct.\r\n\r\n    Remember to create the schema in the PostgreSQL database if it does not exist.\r\n\r\n3. After configuring the above parameters, run the script to start processing the CSV files. In case of errors, problematic files will be moved to the `temp/processed` folder and errors logged in the `error-log.csv` file.\r\n\r\n## Usage 🚀\r\n\r\nTo use the Text To DB Converter, follow these steps:\r\n\r\n1. Open your command line interface (CLI).\r\n2. Navigate to the directory where the `main.py` file is located.\r\n3. Run the following command:\r\n\r\n   ```bash\r\n   python main.py\r\n   ```\r\n\r\n## License 📜\r\n\r\nThis project is licensed under the MIT License - see the [LICENSE](LICENSE) for details.\r\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Falefrp%2Ftext_to_db","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Falefrp%2Ftext_to_db","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Falefrp%2Ftext_to_db/lists"}