Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/hanyhm/devops-project
DevOps Project to create complete pipeline
https://github.com/hanyhm/devops-project
actions ansible aws docker eks grafana grafana-dashboard jenkins prometheus terraform
Last synced: about 2 hours ago
JSON representation
DevOps Project to create complete pipeline
- Host: GitHub
- URL: https://github.com/hanyhm/devops-project
- Owner: hanyhm
- License: mit
- Created: 2024-08-08T11:30:12.000Z (about 2 months ago)
- Default Branch: main
- Last Pushed: 2024-08-16T19:17:14.000Z (about 1 month ago)
- Last Synced: 2024-09-27T15:23:18.817Z (about 2 hours ago)
- Topics: actions, ansible, aws, docker, eks, grafana, grafana-dashboard, jenkins, prometheus, terraform
- Language: JavaScript
- Homepage:
- Size: 757 KB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# DevOps Mastery Project
## Project Summary
This project demonstrates a comprehensive, end-to-end DevOps pipeline for a sample web application.
It showcases the implementation of modern DevOps practices and tools, focusing on automation,
continuous integration, continuous deployment, infrastructure as code, and monitoring.
The pipeline is designed to streamline the development process, ensure code quality,
and enable rapid, reliable deployments.
## 1. Project Overview
### 1.1 Objective
The primary objective of this project is to create a robust, scalable,
and automated DevOps pipeline that demonstrates proficiency in key DevOps tools and practices.
This pipeline will support the full lifecycle of a web application,
from development to production deployment and monitoring.
### 1.2 Architecture & Scope
The project scope encompasses:
1. Setting up a version control system for source code management
2. Implementing a CI/CD pipeline for automated testing and deployment
3. Utilizing infrastructure as code for provisioning and managing cloud resources
4. Containerizing the application and orchestrating it with Kubernetes
5. Implementing configuration management for consistent environment setup
6. Setting up comprehensive monitoring and observability solutions
### 1.3 Key Features
- Automated build and test processes
- Infrastructure provisioning using code
- Containerized application deployment
- Multi-environment support (development, staging, production)
- Automated deployment with zero downtime
- Real-time monitoring and alerting
- Scalable and fault-tolerant architecture
### 1.4 Technologies Used
- Version Control: **GitHub**
- CI/CD: **GitHub Actions**, **Jenkins**
- Infrastructure as Code: **Terraform**
- Configuration Management: **Ansible**
- Containerization: **Docker**
- Container Orchestration: Kubernetes (**Amazon EKS**)
- Monitoring and Observability: **Prometheus**, **Grafana**
- Cloud Provider: **AWS**
## 2. Pipeline Overview
The DevOps pipeline consists of the following stages:
1. **Code Commit**: Developers push code to GitHub repository
2. **Continuous Integration**:
- GitHub Actions triggers automated tests
- Build Docker image
3. **Artifact Storage**: Push Docker image to Amazon ECR
4. **Continuous Deployment**:
- Jenkins pulls the latest image
- Deploy to Kubernetes cluster (EKS)
5. **Infrastructure Management**:
- Terraform provisions and updates AWS resources
- Ansible configures instances and applications
6. **Monitoring and Feedback**:
- Prometheus collects metrics
- Grafana visualizes performance data
- Alerts sent for any issues
## 3. How to use this Project
1- Clone the project repo. to get the source code locally.
```sh
git clone https://github.com/hanyhm/DevOps-Project.git
```
2- Install and configure Amazon CLI
```bash
$ sudo apt-get install python3-pip
$ sudo apt install pipx
$ pipx install awscli
$ pipx ensurepath
$ aws configure
$ AWS Access Key ID [None]: // Input your aws access key
$ AWS Secret Access Key [None]: // Input your secret access key
$ Default region name [None]: us-east-1
$ Default output format [None]: json
```
3- Test the CI Cycle
a. Create GitHub repo. and upload the project source code.
b. Upload the source code to your repo.
c. Go to the repo. settings and add the following parameters:
```bash
AWS_ACCESS_KEY_ID = "your_access_key"
AWS_SECRET_ACCESS_KEY = "your_secret_key"
AWS_REGION = "your_region"
ECR_REGISTRY = "your ecr registry"
```