{"id":25268238,"url":"https://github.com/ilyass-bougati/cdb","last_synced_at":"2026-05-03T15:35:39.683Z","repository":{"id":276028404,"uuid":"927857088","full_name":"Ilyass-Bougati/CDB","owner":"Ilyass-Bougati","description":"This is a project is all about turning a big CSV file to a postgres table, it automatically detects the type and generates a schema and create the table for you","archived":false,"fork":false,"pushed_at":"2025-06-29T09:54:34.000Z","size":704,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-06-29T10:35:00.449Z","etag":null,"topics":["data-science","docker-compose","pandas","postgresql","python"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Ilyass-Bougati.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2025-02-05T16:54:20.000Z","updated_at":"2025-06-29T09:54:38.000Z","dependencies_parsed_at":"2025-02-05T22:27:32.868Z","dependency_job_id":"e5c02a00-4cb8-48d3-8250-d646c7f8e620","html_url":"https://github.com/Ilyass-Bougati/CDB","commit_stats":null,"previous_names":["ilyass-bougati/cdb"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/Ilyass-Bougati/CDB","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Ilyass-Bougati%2FCDB","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Ilyass-Bougati%2FCDB/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Ilyass-Bougati%2FCDB/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Ilyass-Bougati%2FCDB/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Ilyass-Bougati","download_url":"https://codeload.github.com/Ilyass-Bougati/CDB/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Ilyass-Bougati%2FCDB/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":276975610,"owners_count":25738503,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-09-25T02:00:09.612Z","response_time":80,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["data-science","docker-compose","pandas","postgresql","python"],"created_at":"2025-02-12T10:24:24.135Z","updated_at":"2025-09-25T19:58:47.513Z","avatar_url":"https://github.com/Ilyass-Bougati.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# CDB - CSV to DB\n![python](https://img.shields.io/badge/Python-FFD43B?style=for-the-badge\u0026logo=python\u0026logoColor=blue)\n![pandas](https://img.shields.io/badge/Pandas-2C2D72?style=for-the-badge\u0026logo=pandas\u0026logoColor=white)\n![postgres](https://img.shields.io/badge/PostgreSQL-316192?style=for-the-badge\u0026logo=postgresql\u0026logoColor=white)\n![docker](https://img.shields.io/badge/Docker-2CA5E0?style=for-the-badge\u0026logo=docker\u0026logoColor=white)\n\nThis is a project is all about turning a big CSV file to a [postgres](https://www.postgresql.org/) table, it automatically detects the type and generates a schema and create the table for you, all you need to do is ensure there are no duplicate column names and that the column names don't go over the postgres limit of size (31 as I know).\n\n# Environment variables\nBefore running the project, you must create a `.env` file where you define the following variables\n```env\nPOSTGRES_USER=...\nPOSTGRES_PASSWORD=...\nTABLE_NAME=...\n```\n\n# Database\nIf you don't have postgres installed, you can use [docker](https://www.docker.com/), and run the following command to start a postgresql container\n```bash\ndocker compose up\n```\n\n# Cloning\nSince I've used one submodule [plog](https://github.com/Ilyass-Bougati/plog) you'll have to clone this repo recursively\n```bash\ngit clone --recursive git@github.com:Ilyass-Bougati/CDB.git\n```\n\n# Usage\nrunning the program after setting things up, is as easy as it could get\n```bash\npython cdb.py filepath\n```","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Filyass-bougati%2Fcdb","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Filyass-bougati%2Fcdb","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Filyass-bougati%2Fcdb/lists"}