{"id":24458308,"url":"https://github.com/olamide100/datawiz","last_synced_at":"2026-03-16T20:33:34.991Z","repository":{"id":195312061,"uuid":"692220373","full_name":"OLAMIDE100/DATAWIZ","owner":"OLAMIDE100","description":"Agricultural Monitoring Systems  Overview This dataset simulates real-time agricultural sensor data, providing a rich source of information to design and construct a robust data engineering solution. ","archived":false,"fork":false,"pushed_at":"2023-09-17T20:17:38.000Z","size":1297,"stargazers_count":1,"open_issues_count":0,"forks_count":1,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-03-14T08:43:02.949Z","etag":null,"topics":["agriculture","datafest","dbt"],"latest_commit_sha":null,"homepage":"","language":null,"has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/OLAMIDE100.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null}},"created_at":"2023-09-15T20:55:27.000Z","updated_at":"2023-09-19T08:15:54.000Z","dependencies_parsed_at":"2023-09-17T12:32:44.240Z","dependency_job_id":null,"html_url":"https://github.com/OLAMIDE100/DATAWIZ","commit_stats":null,"previous_names":["olamide100/datawiz"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/OLAMIDE100/DATAWIZ","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/OLAMIDE100%2FDATAWIZ","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/OLAMIDE100%2FDATAWIZ/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/OLAMIDE100%2FDATAWIZ/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/OLAMIDE100%2FDATAWIZ/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/OLAMIDE100","download_url":"https://codeload.github.com/OLAMIDE100/DATAWIZ/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/OLAMIDE100%2FDATAWIZ/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28120537,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-12-29T02:00:07.021Z","response_time":58,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["agriculture","datafest","dbt"],"created_at":"2025-01-21T03:13:41.218Z","updated_at":"2025-12-29T20:04:34.813Z","avatar_url":"https://github.com/OLAMIDE100.png","language":null,"funding_links":[],"categories":[],"sub_categories":[],"readme":"\u003cdiv id=\"top\"\u003e\u003c/div\u003e\n\u003c!--\n*** Thanks for checking out the Best-README-Template. If you have a suggestion\n*** that would make this better, please fork the repo and create a pull request\n*** or simply open an issue with the tag \"enhancement\".\n*** Don't forget to give the project a star!\n*** Thanks again! Now go create something AMAZING! :D\n--\u003e\n\n\n\n\u003c!-- PROJECT SHIELDS --\u003e\n\u003c!--\n*** I'm using markdown \"reference style\" links for readability.\n*** Reference links are enclosed in brackets [ ] instead of parentheses ( ).\n*** See the bottom of this document for the declaration of the reference variables\n*** for contributors-url, forks-url, etc. This is an optional, concise syntax you may use.\n*** https://www.markdownguide.org/basic-syntax/#reference-style-links\n--\u003e\n\n\n\n\u003c!-- PROJECT LOGO --\u003e\n\u003cbr /\u003e\n\u003cdiv align=\"center\"\u003e\n \n\n  \u003ch3 align=\"center\"\u003eTeam-DataWiz DatafestAfrica Datathon 2023 - Data Engineering Project\u003c/h3\u003e\n\n  \u003cp align=\"center\"\u003e\n    A wrap-up project for the 3-day DatafestAfrica Datathon 2023!\n    \u003cbr /\u003e\n    \u003ca href=\"https://github.com/OLAMIDE100/DATAWIZ\"\u003e\u003cstrong\u003eExplore the docs »\u003c/strong\u003e\u003c/a\u003e\n    \u003cbr /\u003e\n    \u003cbr /\u003e\n    ·\n   \n  \u003c/p\u003e\n\u003c/div\u003e\n\n\n\n\u003c!-- TABLE OF CONTENTS --\u003e\n\u003cdetails\u003e\n  \u003csummary\u003eTable of Contents\u003c/summary\u003e\n  \u003col\u003e\n    \u003cli\u003e\n      \u003ca href=\"#about-the-project\"\u003eAbout The Project\u003c/a\u003e\n      \u003cul\u003e\n        \u003cli\u003e\u003ca href=\"#built-with\"\u003eBuilt With\u003c/a\u003e\u003c/li\u003e\n        \u003cli\u003e\u003ca href=\"#architecture\"\u003eArchitecture\u003c/a\u003e\u003c/li\u003e\n      \u003c/ul\u003e\n    \u003c/li\u003e\n    \u003cli\u003e\u003ca href=\"#usage\"\u003eUsage\u003c/a\u003e\u003c/li\u003e\n    \u003cli\u003e\u003ca href=\"#roadmap\"\u003eRoadmap\u003c/a\u003e\u003c/li\u003e\n    \u003cli\u003e\u003ca href=\"#pipeline\"\u003ePipeline\u003c/a\u003e\u003c/li\u003e\n   \u003cli\u003e\n      \u003ca href=\"#deliverables\"\u003eDeliverables\u003c/a\u003e\n      \u003cul\u003e\n        \u003cli\u003e\u003ca href=\"#jobs\"\u003eJobs\u003c/a\u003e\u003c/li\u003e\n        \u003cli\u003e\u003ca href=\"#environments\"\u003eEnvironments\u003c/a\u003e\u003c/li\u003e\n        \u003cli\u003e\u003ca href=\"#runs\"\u003eRuns\u003c/a\u003e\u003c/li\u003e\n      \u003c/ul\u003e\n    \u003c/li\u003e\n    \n    \n  \u003c/ol\u003e\n\u003c/details\u003e\n\n\n\n\u003c!-- ABOUT THE PROJECT --\u003e\n## About The Project\n\n\u003cdiv align=\"center\"\u003e\n  \u003ch1\u003eAgricultural Monitoring Systems\u003c/h1\u003e\n  \n  \u003ca href=\"\"\u003e\n    \u003cimg src=\"image/Precision-Agriculture.png\" alt=\"Logo\" width=\"800\" height=\"200\"\u003e\n  \u003c/a\u003e\n \u003c/div\u003e\n\n\nOur business operates in the agricultural sector, where monitoring various environmental conditions and sensor data is crucial for optimizing crop yields and ensuring sustainable farming practices. This datathon is aligned with our commitment to leverage data engineering to streamline the processing and analysis of agricultural data.\n\u003cp align=\"right\"\u003e(\u003ca href=\"#top\"\u003eback to top\u003c/a\u003e)\u003c/p\u003e\n\n### Architecture\n\n![architecture diagram](https://github.com/OLAMIDE100/DATAWIZ/blob/main/image/ETL.png)\n\n### Built With\n\nLanguage, frameworks, libraries, Services and Tools used to bootstrap this project.\n\n* DBT \n* Snowflake\n* GitHub\n* SQL\n* Jinja Template\n\n\n\u003cp align=\"right\"\u003e(\u003ca href=\"#top\"\u003eback to top\u003c/a\u003e)\u003c/p\u003e\n\n\n\n\u003c!-- USAGE EXAMPLES --\u003e\n## Usage\n\nThis dataset simulates real-time agricultural sensor data, providing a rich source of information to design and construct a robust data engineering solution. The primary objective of this project is to extract, transform, and load (ETL) the raw sensor data into structured fact and dimension tables within our snowflake data warehouse.\n\n\n\u003cp align=\"right\"\u003e(\u003ca href=\"#top\"\u003eback to top\u003c/a\u003e)\u003c/p\u003e\n\n\n\n\u003c!-- ROADMAP --\u003e\n## Roadmap\n\n- [x] Create a Snowflakes Account\n- [x] Setup DBT cloud or core using the snowflake as its warehouse\n- [x] Data Modelling (logical and business)\n- [x] Develop\n- [x] Test and Documentation\n- [x] Create Jobs\n- [x] Deploy to Production\n\n\n\n\n\u003c!-- Pipeline --\u003e\n## Pipeline\n\n![pipeline diagram](https://github.com/OLAMIDE100/DATAWIZ/blob/main/image/pipeline.png)\n\n## Deliverables\n\n### Jobs\n\n![jobs diagram](https://github.com/OLAMIDE100/DATAWIZ/blob/main/image/Jobs.png)\n\n### Environments\n\n![environments diagram](https://github.com/OLAMIDE100/DATAWIZ/blob/main/image/Environments.png)\n\n### Runs\n\n![Hourly_transform_load_run_history](https://github.com/OLAMIDE100/DATAWIZ/blob/main/image/Hourly_transform_load_run_history.png)\n\n![6_hours_test_run_history diagram](https://github.com/OLAMIDE100/DATAWIZ/blob/main/image/6_hours_test_run_history.png)\n\n\n\n\n\n\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Folamide100%2Fdatawiz","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Folamide100%2Fdatawiz","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Folamide100%2Fdatawiz/lists"}