{"id":23819776,"url":"https://github.com/jcm-ai/robust-mlops-elevating-machine-learning-to-production-scale","last_synced_at":"2026-04-09T15:52:18.079Z","repository":{"id":266266391,"uuid":"897805990","full_name":"jcm-ai/Robust-MLOps-Elevating-Machine-Learning-to-Production-Scale","owner":"jcm-ai","description":"This project aims to address the challenge faced by the Office of Foreign Labor Certification in managing a high volume of job certification applications for employers seeking to hire foreign workers in the United States. By leveraging ML models, this project seeks to streamline the process of shortlisting visa applicants based on historical data.","archived":false,"fork":false,"pushed_at":"2024-12-18T12:15:33.000Z","size":7691,"stargazers_count":0,"open_issues_count":0,"forks_count":2,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-02-21T22:42:05.156Z","etag":null,"topics":["aws-ec2","aws-ecr","aws-s3","cicd-pipeline","data-science","docker-image","end-to-end","exploratory-data-analysis","git","github-actions","html","machine-learning-models","mlops","mlops-project","model-deployment","mongodb","numpy","pandas","python","yaml"],"latest_commit_sha":null,"homepage":"","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/jcm-ai.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-12-03T09:18:41.000Z","updated_at":"2024-12-18T12:15:37.000Z","dependencies_parsed_at":"2024-12-18T13:34:14.514Z","dependency_job_id":null,"html_url":"https://github.com/jcm-ai/Robust-MLOps-Elevating-Machine-Learning-to-Production-Scale","commit_stats":null,"previous_names":["jagadishmali567/robust-mlops-elevating-machine-learning-to-production-scale","jcm-ai/robust-mlops-elevating-machine-learning-to-production-scale"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jcm-ai%2FRobust-MLOps-Elevating-Machine-Learning-to-Production-Scale","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jcm-ai%2FRobust-MLOps-Elevating-Machine-Learning-to-Production-Scale/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jcm-ai%2FRobust-MLOps-Elevating-Machine-Learning-to-Production-Scale/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jcm-ai%2FRobust-MLOps-Elevating-Machine-Learning-to-Production-Scale/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/jcm-ai","download_url":"https://codeload.github.com/jcm-ai/Robust-MLOps-Elevating-Machine-Learning-to-Production-Scale/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":240100517,"owners_count":19747683,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["aws-ec2","aws-ecr","aws-s3","cicd-pipeline","data-science","docker-image","end-to-end","exploratory-data-analysis","git","github-actions","html","machine-learning-models","mlops","mlops-project","model-deployment","mongodb","numpy","pandas","python","yaml"],"created_at":"2025-01-02T07:15:10.638Z","updated_at":"2025-12-30T19:58:54.712Z","avatar_url":"https://github.com/jcm-ai.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Robust MLOps: Elevating Machine Learning to Production Scale\n**This is the final outcome of this project:**\n\n![us-visa](https://github.com/user-attachments/assets/4bdfc657-a0bd-4543-b82b-ae3bec2a94a2)\n\n\n\n- [Anaconda](https://www.anaconda.com/)\n- [Vs Code](https://code.visualstudio.com/download)\n- [Git and Git Bash](https://git-scm.com/)\n- [Flowchart](https://whimsical.com/)\n- [MLOps Tool](https://www.evidentlyai.com/) - Evidently AI\n- [MongoDB](https://account.mongodb.com/account/login)\n- [Dataset link](https://www.kaggle.com/datasets/moro23/easyvisa-dataset)\n- [Cloud Computing](https://aws.amazon.com/free)\n\n\n## Git commands\n\n\n```Bash\ngit add .\n```\n```Bash\ngit commit -m \"Updated\"\n```\n```Bash\ngit push origin main\n```\n\n\n## How to run?\n\n\n```Bash\nconda create -n usvisa python=3.8 -y\n```\n\n```Bash\nsource activate base\n```\n\n```Bash\nconda activate usvisa\n```\n\n```Bash\npip install -r requirements.txt\n```\n\n\n## Project WorkFlow:\n\n1. constants\n2. entity\n3. components\n4. pipeline\n5. Main file\n\n\n\n## Export the environment variable:\n\n```Bash\nexport MONGODB_URL=\"mongodb+srv://\u003cusername\u003e:\u003cpassword\u003e....\"\n```\n\n```Bash\nexport AWS_ACCESS_KEY_ID=\u003cAWS_ACCESS_KEY_ID\u003e\n```\n\n```Bash\nexport AWS_SECRET_ACCESS_KEY=\u003cAWS_SECRET_ACCESS_KEY\u003e\n```\n\n\n## AWS CICD Deployment with Github Actions\n\n### 1. Login to AWS console.\n\n### 2. Create IAM user for deployment\n\n#### with specific access:\n\n1. EC2 access : It is virtual machine\n\n2. ECR: Elastic Container registry to save your docker image in aws\n\n\n#### Description: About the deployment\n\n1. Build docker image of the source code\n\n2. Push your docker image to ECR\n\n3. Launch Your EC2\n\n4. Pull Your image from ECR in EC2\n\n5. Lauch your docker image in EC2\n\n\n#### Policy:\n```Bash\n1. AmazonEC2ContainerRegistryFullAccess\n```\n```Bash\n2. AmazonEC2FullAccess\n```\n```Bash\n3. AmazonS3FullAccess\n```\n\n### 3. Create ECR repo to store/save docker image\n```Bash\nSave the URI: 954976285001.dkr.ecr.us-east-1.amazonaws.com/usvisa\n```\n\n### 4. Create EC2 machine (Ubuntu)\n\n### 5. Open EC2 and Install docker in EC2 Machine:\n\n**optinal**\n\n```Bash\nsudo apt-get update -y\n```\n```Bash\nsudo apt-get upgrade\n```\n**required**\n\n```Bash\ncurl -fsSL https://get.docker.com -o get-docker.sh\n```\n```Bash\nsudo sh get-docker.sh\n```\n```Bash\nsudo usermod -aG docker ubuntu\n```\n```Bash\nnewgrp docker\n```\n\n\n### 6. Configure EC2 as self-hosted runner:\n\n```Bash\nsetting\u003eactions\u003erunner\u003enew self hosted runner\u003e choose os\u003e then run command one by one\n```\n\n### 7. Setup github secrets:\n\n- AWS_ACCESS_KEY_ID\n- AWS_SECRET_ACCESS_KEY\n- AWS_DEFAULT_REGION\n- ECR_REPO\n- MONGODB_URL\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjcm-ai%2Frobust-mlops-elevating-machine-learning-to-production-scale","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fjcm-ai%2Frobust-mlops-elevating-machine-learning-to-production-scale","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fjcm-ai%2Frobust-mlops-elevating-machine-learning-to-production-scale/lists"}