{"id":18335676,"url":"https://github.com/data-engineering-community/data-engineering-project-template","last_synced_at":"2025-04-06T04:34:15.625Z","repository":{"id":46591721,"uuid":"404963915","full_name":"data-engineering-community/data-engineering-project-template","owner":"data-engineering-community","description":"This is a template you can use for your next data engineering portfolio project.","archived":false,"fork":false,"pushed_at":"2021-09-10T05:56:53.000Z","size":140,"stargazers_count":117,"open_issues_count":0,"forks_count":28,"subscribers_count":3,"default_branch":"main","last_synced_at":"2024-05-01T11:29:16.205Z","etag":null,"topics":["data","data-engineering","data-warehouse","etl","etl-pipeline","python","sql"],"latest_commit_sha":null,"homepage":"https://dataengineering.wiki","language":null,"has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/data-engineering-community.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2021-09-10T05:13:04.000Z","updated_at":"2024-04-24T22:30:23.000Z","dependencies_parsed_at":"2022-09-13T15:12:11.853Z","dependency_job_id":null,"html_url":"https://github.com/data-engineering-community/data-engineering-project-template","commit_stats":null,"previous_names":[],"tags_count":0,"template":true,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/data-engineering-community%2Fdata-engineering-project-template","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/data-engineering-community%2Fdata-engineering-project-template/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/data-engineering-community%2Fdata-engineering-project-template/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/data-engineering-community%2Fdata-engineering-project-template/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/data-engineering-community","download_url":"https://codeload.github.com/data-engineering-community/data-engineering-project-template/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":223238113,"owners_count":17111359,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["data","data-engineering","data-warehouse","etl","etl-pipeline","python","sql"],"created_at":"2024-11-05T20:04:00.125Z","updated_at":"2024-11-05T20:04:00.819Z","avatar_url":"https://github.com/data-engineering-community.png","language":null,"readme":"# Data Engineering Project Template\n\nThis is a template you can use for your next data engineering portfolio project. To copy it, log into GitHub and click on the **Use this template** button above.\n\n![GitHub use this template button](use-this-template-button.png)\n\n## Overview\n\nHere you want to write a short overview of the goals of your project and how it works at a high level. If possible, include one or two images of the end product and architecture diagram (see examples below). diagrams.net is a great tool for creating architecture diagrams.\n\n### Data Visualization\n\n![Example dashboard image](example-dashboard.png)\n\n### Data Architecture\n\n![Example architecture image](example-architecture.png)\n\nIf you decide to include this, you should also talk a bit about why you chose the architecture and tools you did for this project.\n\n## Prerequisites\n\nDirections or anything needed before running the project.\n\n- Prerequisite 1\n- Prerequisite 2\n- Prerequisite 3\n\n## How to Run This Project\n\nReplace the example step-by-step instructions with your own.\n\n1. Install x packages\n2. Run command: `python x`\n3. Make sure it's running properly by checking z\n4. To clean up at the end, run script: `python cleanup.py`\n\n## Lessons Learned\n\nIt's good to reflect on what you learned throughout the process of building this project. Here you might discuss what you would have done differently if you had more time/money/data. Did you end up choosing the right tools or would you try something else next time?\n\n## Contact\n\nPlease feel free to contact me if you have any questions at: LinkedIn, Twitter\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdata-engineering-community%2Fdata-engineering-project-template","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdata-engineering-community%2Fdata-engineering-project-template","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdata-engineering-community%2Fdata-engineering-project-template/lists"}