{"id":13474962,"url":"https://github.com/data-engineering-community/data-engineering-wiki","last_synced_at":"2025-05-14T13:07:26.401Z","repository":{"id":38105306,"uuid":"364093960","full_name":"data-engineering-community/data-engineering-wiki","owner":"data-engineering-community","description":"The best place to learn data engineering. Built and maintained by the data engineering community.","archived":false,"fork":false,"pushed_at":"2025-04-07T05:06:17.000Z","size":8212,"stargazers_count":1632,"open_issues_count":5,"forks_count":183,"subscribers_count":28,"default_branch":"main","last_synced_at":"2025-04-12T13:57:32.335Z","etag":null,"topics":["data","data-engineer","data-engineering","data-modeling","data-pipelines","database","etl","sql"],"latest_commit_sha":null,"homepage":"https://dataengineering.wiki","language":"CSS","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"cc0-1.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/data-engineering-community.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":".github/FUNDING.yml","license":"LICENSE","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null},"funding":{"github":["data-engineering-community"]}},"created_at":"2021-05-04T00:07:33.000Z","updated_at":"2025-04-11T17:54:31.000Z","dependencies_parsed_at":"2024-11-09T17:22:23.209Z","dependency_job_id":"6a374085-18d7-4989-8f0f-e660bc93c314","html_url":"https://github.com/data-engineering-community/data-engineering-wiki","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/data-engineering-community%2Fdata-engineering-wiki","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/data-engineering-community%2Fdata-engineering-wiki/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/data-engineering-community%2Fdata-engineering-wiki/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/data-engineering-community%2Fdata-engineering-wiki/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/data-engineering-community","download_url":"https://codeload.github.com/data-engineering-community/data-engineering-wiki/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":254149958,"owners_count":22022851,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["data","data-engineer","data-engineering","data-modeling","data-pipelines","database","etl","sql"],"created_at":"2024-07-31T16:01:16.273Z","updated_at":"2025-05-14T13:07:21.384Z","avatar_url":"https://github.com/data-engineering-community.png","language":"CSS","readme":"\u003cdiv align=\"center\"\u003e\n  \u003ca href=\"https://github.com/data-engineering-community/data-engineering-wiki\"\u003e\n    \u003cimg width=\"200\" height=\"200\" src=\"Assets/logo.svg\"\u003e\n  \u003c/a\u003e\n  \u003cbr\u003e\n  \u003cimg alt=\"GitHub repo size\" src=\"https://img.shields.io/github/repo-size/data-engineering-community/data-engineering-wiki\"\u003e\n  \u003ca href=\"https://dataengineering.wiki\"\u003e\n  \u003cimg alt=\"Website\" src=\"https://img.shields.io/website?url=https%3A%2F%2Fdataengineering.wiki\"\u003e\n  \u003c/a\u003e\n\n# Data Engineering Wiki\n\nThe best place to learn data engineering. Built and maintained by the [data engineering community](https://dataengineering.wiki/Community/Community).\n\n[![Subreddit subscribers](https://img.shields.io/reddit/subreddit-subscribers/dataengineering?style=social)](https://www.reddit.com/r/dataengineering/)\n\u003c/div\u003e\n\n## What's inside?\n\nA collection of notes that are connected organically but loosely organized into the following categories:\n\n1. **[Concepts](https://dataengineering.wiki/Concepts/Concepts):** Concepts related to Data Engineering.\n2. **[FAQ](https://dataengineering.wiki/FAQ/FAQ):** Frequently asked questions about Data Engineering.\n3. **[Guides](https://dataengineering.wiki/Guides/Guides):** Understand how to make Data Engineering decisions.\n4. **[Tools](https://dataengineering.wiki/Tools/Tools):** Commonly used tools for Data Engineering.\n5. **[Tutorials](https://dataengineering.wiki/Tutorials/Tutorials):** Step-by-step instructions for Data Engineering tasks.\n6. **[Learning Resources](https://dataengineering.wiki/Learning+Resources):** Learn Data Engineering with resources recommended by the Data Engineering community.\n\n## Sponsors\n\nThe Data Engineering Wiki is an CC0-1.0-licensed open source project with its ongoing development made possible entirely by the support of these awesome [backers](https://github.com/data-engineering-community/data-engineering-wiki/blob/main/BACKERS.md). If you'd like to join them, please consider [sponsoring the Data Engineering Wiki's development](https://github.com/sponsors/data-engineering-community).\n\n\u003cdiv align=\"center\"\u003e\n\n## Gold Sponsors\n\n\u003ca href=\"https://dataengjobs.com/\"\u003e\n    \u003cimg src=\"https://avatars.githubusercontent.com/u/109050594?v=4\" width=250\u003e\n\u003c/a\u003e\n\u003ca href=\"https://greatexpectations.io/cloud/?utm_source=reddit\u0026utm_medium=sponsored\u0026utm_campaign=r-dataengineering\u0026utm_content=cloud-signup\"\u003e\n    \u003cimg src=\"https://raw.githubusercontent.com/data-engineering-community/data-engineering-wiki/41d72633bf4c6fea9f1d073f590dfc7d331359b4/Assets/great-expectations-logo.svg\" width=250\u003e\n\u003c/a\u003e\n\n## Silver Sponsors\n\n\u003ca href=\"https://bit.ly/dataengwiki\"\u003e\n    \u003cimg src=\"https://raw.githubusercontent.com/data-engineering-community/data-engineering-wiki/main/Assets/starburst-logo.svg\" width=200\u003e\n\u003c/a\u003e\n\n\u003c/div\u003e\n\n## How to run it locally\n\nThe wiki can be used offline and can be used as-is or incorporated into your own personal knowledge management system. It is built to be used with [Obsidian](https://obsidian.md/) (free, no affiliation) but is compatible with other tools as well such as [Foam](https://github.com/foambubble/foam) or [Roam Research](https://roamresearch.com/).\n\n1. Download this GitHub repository.\n2. Download the free [Obsidian desktop app](https://obsidian.md/).\n3. Run the Obsidian app and choose **Open folder as vault**, click **Open**.\n4. In the file browser, choose the folder where you downloaded the GitHub repository, click **Open**.\n\nSee [Obsidian help](https://help.obsidian.md/) for questions on using Obsidian.\n\n## Contributing\n\nThere are many different ways to contribute to the wiki's development. If you're interested, check out our [contributing guidelines](https://github.com/data-engineering-community/data-engineering-wiki/blob/main/CONTRIBUTING.md) to learn how you can get involved.\n\nThank you to all of our [contributors](https://github.com/data-engineering-community/data-engineering-wiki/graphs/contributors) who shared their data engineering knowledge!\n\n\u003ca href=\"https://github.com/data-engineering-community/data-engineering-wiki/graphs/contributors\"\u003e\n  \u003cimg src=\"https://contrib.rocks/image?repo=data-engineering-community/data-engineering-wiki\" /\u003e\n\u003c/a\u003e\n","funding_links":["https://github.com/sponsors/data-engineering-community"],"categories":["CSS","Table of vault + website classified by topics (43)"],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdata-engineering-community%2Fdata-engineering-wiki","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdata-engineering-community%2Fdata-engineering-wiki","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdata-engineering-community%2Fdata-engineering-wiki/lists"}