Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/harshilshah2501/cross-cloud-benchmark

a benchmarking tool to evaluate microservices’ performance across different cloud providers.
https://github.com/harshilshah2501/cross-cloud-benchmark

aws azure gcp grafana prometheus terraform vault

Last synced: about 1 month ago
JSON representation

a benchmarking tool to evaluate microservices’ performance across different cloud providers.

Host: GitHub
URL: https://github.com/harshilshah2501/cross-cloud-benchmark
Owner: harshilshah2501
License: mit
Created: 2024-12-03T08:08:40.000Z (about 1 month ago)
Default Branch: main
Last Pushed: 2024-12-07T08:56:15.000Z (about 1 month ago)
Last Synced: 2024-12-07T09:25:32.697Z (about 1 month ago)
Topics: aws, azure, gcp, grafana, prometheus, terraform, vault
Language: HCL
Homepage:
Size: 67.4 KB
Stars: 0
Watchers: 1
Forks: 0
Open Issues: 0
Metadata Files:
- Readme: README.md
- License: LICENSE

Awesome Lists containing this project

README

# Cross-Cloud Microservices Performance Benchmarking Tool

## Overview

The **Cross-Cloud Microservices Performance Benchmarking Tool** is a comprehensive framework to benchmark the performance of microservices across different cloud providers (CSPs) such as AWS, GCP, and OpenStack. It leverages **Terraform** for vendor-agnostic infrastructure provisioning, **HashiCorp Vault** for secure secret management, and tools like **Prometheus** and **Grafana** for metrics collection and visualization.

### Key Features

- **Vendor-Agnostic Infrastructure Management**: Automate resource provisioning on AWS, GCP, and OpenStack using Terraform.
- **Secure Secrets Management**: Use HashiCorp Vault to securely manage CSP credentials and other sensitive data.
- **Microservices Deployment**: Deploy identical gRPC-based microservices on different cloud platforms using Docker.
- **Benchmarking and Metrics**: Measure key metrics like latency, throughput, scalability, and cost-performance using Prometheus and Grafana.
- **Actionable Insights**: Generate comparative analyses of cloud providers to identify the optimal environment for specific workloads.

---

## Architecture

```plaintext
+---------------------------------------------------+
| Cross-Cloud Benchmark Tool |
|---------------------------------------------------|
| Orchestration: Terraform |
| Secret Management: HashiCorp Vault |
| Benchmarking: Load Testing, Metrics Collection |
| Visualization: Grafana |
+---------------------------------------------------+
|
v
+---------------------------------------------------+
| Cloud Providers (CSPs) |
|---------------------------------------------------|
| AWS GCP OpenStack |
| - EC2 Instances - VM Instances - VMs |
| - Load Balancers - Load Balancers - Network |
| - Networking - Networking - Storage |
+---------------------------------------------------+
|
v
+---------------------------------------------------+
| Microservices Deployed on CSPs |
|---------------------------------------------------|
| gRPC Microservice |
| - Containerized via Docker |
| - Identical deployment across CSPs |
+---------------------------------------------------+
|
v
+---------------------------------------------------+
| Benchmarking and Metrics Collection |
|---------------------------------------------------|
| Load Testing Tools: |
| - k6, wrk, ghz (simulate load) |
| Metrics Exporters: |
| - Prometheus (collect latency, throughput, etc.) |
+---------------------------------------------------+
|
v
+---------------------------------------------------+
| Visualization Layer |
|---------------------------------------------------|
| Grafana Dashboards: |
| - Latency Comparison (AWS vs GCP vs OpenStack) |
| - Resource Usage (CPU, Memory, etc.) |
| - Cost Analysis |
+---------------------------------------------------+
```
## Getting Started

### Prerequisites
1. **Terraform**: Install Terraform here.
2. **HashiCorp Vault**: Install Vault here.
3. **Docker**: Install Docker here.
4. **Prometheus and Grafana**:
- **Prometheus** installation guide.
- **Grafana** installation guide.

### Repository Structure
```plaintext
├── terraform-modules/ # Terraform modules for CSPs
│ ├── aws/ # AWS-specific Terraform configuration
│ ├── gcp/ # GCP-specific Terraform configuration
│ ├── openstack/ # OpenStack-specific Terraform configuration
├── microservices/ # gRPC-based microservices
│ └── Dockerfile # Dockerfile for microservice deployment
├── benchmarks/ # Load testing scripts and tools
├── grafana/ # Grafana configuration and dashboards
├── docs/ # Documentation and resources
├── scripts/ # Helper scripts (e.g., setup, cleanup)
└── README.md # Project documentation
```
---
## Setup

### Step 1: Clone the Repository
```bash
git clone https://github.com/harshilshah2501/cross-cloud-benchmark-.git
cd cross-cloud-benchmark
```
### Step 2: Configure Terraform
**1. Initialize Terraform:**
```bash
terraform init
```
**2. Apply configurations for AWS, GCP, or OpenStack:**
```bash
terraform apply -var="region="
```
### Step 3: Configure HashiCorp Vault
**1. Start Vault:**
```bash
vault server -dev
```
**2. Store CSP credentials securely:**
```bash
vault write aws/creds/benchmark access_key= secret_key=
```
### Step 4: Deploy Microservices
**1. Build and deploy the Docker container:**
```bash
docker build -t grpc-microservice ./microservices
docker run -d -p 50051:50051 grpc-microservice
```
### Step 5: Setup Prometheus and Grafana
**1. Start Prometheus and Grafana using Docker:**
```bash
docker-compose up -d
```
**2. Configure Grafana to use Prometheus as a data source.**

### Usage
1. **Run Load Tests:**
- Use benchmarking tools like k6, wrk, or ghz to simulate traffic and measure performance:
```bash
k6 run benchmarks/load_test.js
```
2. **Monitor Metrics:**
- *Access Grafana at http://localhost:3000 to view performance dashboards.*
3. **Analyze Results:**
- *Compare latency, throughput, and resource usage across CSPs.*
- *Generate cost-performance insights.*
---
# License
This project is licensed under the MIT License. See the LICENSE file for details.
---
# Acknowledgments
- **Terraform**
- **HashiCorp Vault**
- **Prometheus**
- **Grafana**
- **Docker**