https://github.com/fosetorico/ph_level_forecasting
End-to-End Project for pH Level Forecasting of Well Water Samples in Malawi, Conducted by Leeds Beckett University
https://github.com/fosetorico/ph_level_forecasting
api aws docker exploratory-data-analysis feature-extraction flask machine-learning mlops ols-regression outlier-detection pipeline regression regression-models
Last synced: 2 months ago
JSON representation
End-to-End Project for pH Level Forecasting of Well Water Samples in Malawi, Conducted by Leeds Beckett University
- Host: GitHub
- URL: https://github.com/fosetorico/ph_level_forecasting
- Owner: fosetorico
- License: mit
- Created: 2024-05-08T17:29:22.000Z (about 2 years ago)
- Default Branch: main
- Last Pushed: 2024-12-14T19:12:57.000Z (over 1 year ago)
- Last Synced: 2025-06-25T15:02:55.938Z (about 1 year ago)
- Topics: api, aws, docker, exploratory-data-analysis, feature-extraction, flask, machine-learning, mlops, ols-regression, outlier-detection, pipeline, regression, regression-models
- Language: Jupyter Notebook
- Homepage:
- Size: 2.66 MB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# pH Level Forecasting of Well Water Samples in Malawi
This project focuses on an End-to-End Project for Forecasting pH levels of water samples in Malawi, which was conducted by Leeds Beckett University.
## Workflows
- Understanding the Problem Statement
- Exploratory data analysis
- Data Pre-Processing
- Model Training
- Pipelining
- Data Ingestion
- Data Transformation
- Model Trainer
- Prediction Pipelining
## Running Instruction
Clone the Repository
```bash
https://github.com/fosetorico/pH_level_forecasting.git
```
Create a conda environment after opening the repository
```bash
conda create -n your-chosen-name python=3.10 -y
```
```bash
conda activate your-chosen-name
```
## Install the requirements
```bash
pip install -r requirements.txt
```
## Finally run the app
```bash
python app.py
```
### Now,
```bash
open up you local host and port
```
## AWS-CICD-Deployment-with-Github-Actions
With specific access:
1. EC2 access : It is virtual machine
2. ECR: Elastic Container registry to save your docker image in aws
Description: About the deployment
1. Build docker image of the source code
2. Push your docker image to ECR
3. Launch Your EC2
4. Pull Your image from ECR in EC2
5. Lauch your docker image in EC2
Policy:
1. AmazonEC2ContainerRegistryFullAccess
2. AmazonEC2FullAccess
### 1. Login to AWS console.
### 2. Create IAM user for deployment
### 3. Create ECR repo to store/save docker image
### 4. Create EC2 machine (Ubuntu)
### 5. Open EC2 and Install docker in EC2 Machine:
### 6. Configure EC2 as self-hosted runner:
setting>actions>runner>new self hosted runner> choose os> then run command one by one
>>>Optinal<<<
sudo apt-get update -y
sudo apt-get upgrade
>>>Required<<<
curl -fsSL https://get.docker.com -o get-docker.sh
sudo sh get-docker.sh
sudo usermod -aG docker ubuntu
newgrp docker
# 7. Setup github secrets:
AWS_ACCESS_KEY_ID
AWS_SECRET_ACCESS_KEY
AWS_REGION
AWS_ECR_LOGIN_URI
ECR_REPOSITORY_NAME