{"id":20469740,"url":"https://github.com/chandru-21/mlops_project","last_synced_at":"2025-09-24T23:31:05.189Z","repository":{"id":244637744,"uuid":"815804271","full_name":"Chandru-21/MLOps_Project","owner":"Chandru-21","description":"An end-to-end MLOps pipeline(CI/CD/CT/CM) project for training, versioning, deploying, and monitoring machine learning models using FastAPI, Kubernetes, MLflow, DVC, Prometheus, and Grafana.","archived":false,"fork":false,"pushed_at":"2024-07-05T10:49:01.000Z","size":62,"stargazers_count":9,"open_issues_count":0,"forks_count":2,"subscribers_count":2,"default_branch":"main","last_synced_at":"2024-11-15T14:10:06.781Z","etag":null,"topics":["aws","cicd","data-science","docker","dvc","evidentlyai","fastapi","github-actions","grafana","grafana-dashboard","kubernetes","machine-learning","mlops","mlops-community","mlops-project","mlops-template","prometheus"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Chandru-21.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-06-16T07:55:38.000Z","updated_at":"2024-11-03T18:20:41.000Z","dependencies_parsed_at":"2024-06-28T08:09:01.874Z","dependency_job_id":null,"html_url":"https://github.com/Chandru-21/MLOps_Project","commit_stats":null,"previous_names":["chandru-21/mlops_project"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Chandru-21%2FMLOps_Project","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Chandru-21%2FMLOps_Project/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Chandru-21%2FMLOps_Project/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Chandru-21%2FMLOps_Project/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Chandru-21","download_url":"https://codeload.github.com/Chandru-21/MLOps_Project/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":234137678,"owners_count":18785303,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["aws","cicd","data-science","docker","dvc","evidentlyai","fastapi","github-actions","grafana","grafana-dashboard","kubernetes","machine-learning","mlops","mlops-community","mlops-project","mlops-template","prometheus"],"created_at":"2024-11-15T14:10:09.355Z","updated_at":"2025-09-24T23:31:04.899Z","avatar_url":"https://github.com/Chandru-21.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Machine Learning Opearations (MLOps)\n\n## MLOps maturity level 4\n\n## Overview :\nThis project implements a robust MLOps pipeline, facilitating the continuous integration, continuous deployment, and monitoring of machine learning models. The infrastructure leverages AWS, Kubernetes, and various open-source tools to ensure scalability, reproducibility, and maintainability.\n\n\n\n## Architecture :\n\n![image](https://github.com/Chandru-21/MLOps_Project/assets/64595758/123511be-fe66-424d-8776-513b908840fe)\n\n## Key Features :\n\n**Data Versioning** : DVC\n\n**Continuous Integration(CI)** : Triggered through ‘main.yml’ , building the code (docker), tests the code(Pytest),pushes the docker image to AWS ECR. \n\n**Experiment Tracking / Model Versioning** : MLflow \n\n**Continuous Deployment(CD)** : Deploys FastAPI in AWS EKS(kubernetes cluster) for real-time and batch predictions. \n\n**Continuous Monitoring(CM)** : Integrating the ‘/metrics’ method of  FastAPI in Prometheus and visualizes endpoints in Grafana.  \n\n**Continuous Training(CT)** : Triggers code execution through GitHub Actions when new data is pushed to the remote DVC location and committed to Git. \n\n**Drift Monitoring** : Uses a Streamlit app to monitor data drift, target drift, and performs data quality checks.\n\n\n\n\n\n\n## Data Monitoring :\n\n**Data Drift Monitoring** :\n\n![image](https://github.com/Chandru-21/MLOps_Project/assets/64595758/af0df23d-9980-4ee4-94c0-ddebdb923237)\n\n**Data Quality checks** :\n\n![image](https://github.com/Chandru-21/MLOps_Project/assets/64595758/c1c62d64-9b69-4ca7-ba45-45ae226a7620)\n\n\n## Continuous Monitoring(CM)\n\n**Exposing \"/metrics\" on FastAPI to be connected to Prometheus** :\n\n![fastapi](https://github.com/Chandru-21/MLOps_Project/assets/64595758/09b18b44-8cb1-4a86-9172-c79082cb77c8)\n\n**FastAPI integrated in to Prometheus** :\n\n![fastapi_prometheus](https://github.com/Chandru-21/MLOps_Project/assets/64595758/4b21c089-bef3-4e39-b5e1-04cb8e026345)\n\n**Integrating Prometheus in to Grafana for Visualization** :\n\nMonitoring FastAPI methods on Grafana,\n\n![fastapi_continuous_monitoring](https://github.com/Chandru-21/MLOps_Project/assets/64595758/930f0a9a-352f-41f9-8106-9b6735af8ce4)\n\n**Monitoring the resources of the Kubernetes cluster on Grafana** :\n\n![grafana_monitoring_containers_dashboard](https://github.com/Chandru-21/MLOps_Project/assets/64595758/d046d9f9-1477-4975-9041-f4aa128bb0f3)\n\n\n\n\n\n\n\n\n\n\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fchandru-21%2Fmlops_project","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fchandru-21%2Fmlops_project","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fchandru-21%2Fmlops_project/lists"}