{"id":18068446,"url":"https://github.com/chandru-21/llmops","last_synced_at":"2025-08-19T11:31:59.225Z","repository":{"id":258533457,"uuid":"874103839","full_name":"Chandru-21/LLMOps","owner":"Chandru-21","description":"This project(RAG) focuses on operationalizing LLMs by integrating OpenAI, MLflow, FastAPI, and RAGAS for evaluation. It allows users to deploy and manage LLMs, track model runs, and log evaluation metrics in MLflow. The project also features MLflow traces that logs all the user inputs ,responses ,retrieved contexts ,and other essential metrices.","archived":false,"fork":false,"pushed_at":"2024-10-28T07:30:43.000Z","size":2674,"stargazers_count":3,"open_issues_count":0,"forks_count":1,"subscribers_count":2,"default_branch":"master","last_synced_at":"2024-10-31T08:06:28.371Z","etag":null,"topics":["fastapi","genai","llm","llmops","mlflow","mlflow-tracking","openai","rag","ragas"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Chandru-21.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-10-17T09:02:21.000Z","updated_at":"2024-10-28T07:30:47.000Z","dependencies_parsed_at":"2024-10-19T12:59:07.496Z","dependency_job_id":"f59620b3-f7ac-45eb-b658-23769e032f8c","html_url":"https://github.com/Chandru-21/LLMOps","commit_stats":null,"previous_names":["chandru-21/llmops"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Chandru-21%2FLLMOps","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Chandru-21%2FLLMOps/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Chandru-21%2FLLMOps/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Chandru-21%2FLLMOps/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Chandru-21","download_url":"https://codeload.github.com/Chandru-21/LLMOps/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":230351142,"owners_count":18212785,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["fastapi","genai","llm","llmops","mlflow","mlflow-tracking","openai","rag","ragas"],"created_at":"2024-10-31T08:06:31.293Z","updated_at":"2024-12-18T22:40:24.509Z","avatar_url":"https://github.com/Chandru-21.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Retrieval Augmented Generation (RAG)\n\n## RAG LLMOps using OpenAI,MLflow,FastAPI and RAGAS(Evaluation)\n\nStep I : Install all the requirements and execute the RAG_mlflow.py file\n\nNow your LLM model run is registered in MLFlow with its evaluations metrices. \n\n![image](https://github.com/user-attachments/assets/d2114340-6f4b-44fb-a772-38e1d283a157)\n\nRAGAS Evaluation metrics are logged in MLFlow, refer code for further details.\n\nStep II : Execute the app.py (python app.py) in cmd navigate to the FastAPI UI in browser,\n\n![image](https://github.com/user-attachments/assets/535549fc-3595-448c-b30c-2f4cd7a42638)\n\nClick on try it out and enter your question\n\nStep III : Model Monitoring/tracing\n\nNavigate back to the MLflow UI and click on the 'Traces' tab. There, you'll find the question you asked in FastAPI is logged along with its response.\n\n![image](https://github.com/user-attachments/assets/8f4037fb-7533-4ec1-bf20-70319418f252)\n\nClick on the Request id to see more details about the run,\n\n![image](https://github.com/user-attachments/assets/84fe7bdf-db3d-4872-ba70-233088442ef5)\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fchandru-21%2Fllmops","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fchandru-21%2Fllmops","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fchandru-21%2Fllmops/lists"}