https://github.com/punitkumar4871/data_engineering_project
we are building a project which will fetch data from a dynamic pipeline from Github repositary to azure data lake storage Gen 2. after that we will preprocess and clean data in databricks followed by analyzing our datset using big datatools ...... After all preprocessing and analyzing we will train a prediction model on crop yeild.
https://github.com/punitkumar4871/data_engineering_project
Last synced: 4 months ago
JSON representation
we are building a project which will fetch data from a dynamic pipeline from Github repositary to azure data lake storage Gen 2. after that we will preprocess and clean data in databricks followed by analyzing our datset using big datatools ...... After all preprocessing and analyzing we will train a prediction model on crop yeild.
- Host: GitHub
- URL: https://github.com/punitkumar4871/data_engineering_project
- Owner: punitkumar4871
- License: mit
- Created: 2025-03-22T16:56:32.000Z (about 1 year ago)
- Default Branch: main
- Last Pushed: 2025-04-02T14:59:47.000Z (about 1 year ago)
- Last Synced: 2025-04-02T15:38:38.333Z (about 1 year ago)
- Size: 18.7 MB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# data_engineering_project
we are building a project which will fetch data from a dynamic pipeline from Github repositary to azure data lake storage Gen 2. after that we will preprocess and clean data in databricks followed by analyzing our datset using big datatools ...... After all preprocessing and analyzing we will train a prediction model on crop yeild..