{"id":26758260,"url":"https://github.com/ksm26/llmops","last_synced_at":"2025-03-28T16:19:03.656Z","repository":{"id":221690089,"uuid":"755099445","full_name":"ksm26/LLMOps","owner":"ksm26","description":"In this course navigates through the LLMOps pipeline, enabling you to preprocess training data for supervised fine-tuning and deploy custom Large Language Models (LLMs).","archived":false,"fork":false,"pushed_at":"2024-02-13T10:03:44.000Z","size":2079,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2024-02-13T16:44:39.537Z","etag":null,"topics":["data-versioning","deeplearning-ai","deployment","fine-tuning","foundational-models","large-language-models","llmops","model-customization","pipeline-deployment","responsible-ai","supervised-learning"],"latest_commit_sha":null,"homepage":"https://www.deeplearning.ai/short-courses/llmops/","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/ksm26.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null}},"created_at":"2024-02-09T12:55:23.000Z","updated_at":"2024-02-13T16:44:39.538Z","dependencies_parsed_at":"2024-02-12T16:51:25.500Z","dependency_job_id":null,"html_url":"https://github.com/ksm26/LLMOps","commit_stats":null,"previous_names":["ksm26/llmops"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ksm26%2FLLMOps","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ksm26%2FLLMOps/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ksm26%2FLLMOps/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ksm26%2FLLMOps/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/ksm26","download_url":"https://codeload.github.com/ksm26/LLMOps/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":246059327,"owners_count":20717085,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["data-versioning","deeplearning-ai","deployment","fine-tuning","foundational-models","large-language-models","llmops","model-customization","pipeline-deployment","responsible-ai","supervised-learning"],"created_at":"2025-03-28T16:19:01.945Z","updated_at":"2025-03-28T16:19:03.643Z","avatar_url":"https://github.com/ksm26.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# 🚀 [LLMOps](https://www.deeplearning.ai/short-courses/llmops/)\n\n💻 Welcome to the \"LLMOps\" course! Instructed by Erwin Huizenga, Machine Learning Technical Lead at Google, this course will guide you through the LLMOps pipeline, enabling you to pre-process training data for supervised instruction tuning and deploy custom Large Language Models (LLMs).\n\n**Course Website**: 📚[deeplearning.ai](https://www.deeplearning.ai/short-courses/llmops/)\n\u003cp align=\"center\"\u003e\n\u003cimg src=\"images/1_4.png\" height=\"350\"\u003e \n\u003c/p\u003e\n\n## Course Summary\nIn this course, you will dive into the LLMOps pipeline and learn how to adapt it to train and deploy custom LLMs for your specific applications. Here's what you can expect to learn and experience:\n\n1. 🗝 **Fundamentals**: Learn about Data management, Automation and Deployment. This course is about how to build and operate a **${\\textsf{\\color{red}Model Customization workflow}}$** and how to deploy that into **${\\textsf{\\color{red}production}}$**.  \n\u003cp align=\"center\"\u003e\n\u003cimg src=\"images/1_1.png\" height=\"250\"\u003e \n\u003cimg src=\"images/1_3.png\" height=\"350\"\u003e \n\u003c/p\u003e\n\n2. 📊 **Pre-processing Training Data**: Retrieve and transform training data for supervised fine-tuning of an LLM.\n\u003cp align=\"center\"\u003e\n\u003cimg src=\"images/2_1.png\" height=\"200\"\u003e \n\u003c/p\u003e\n\n3. 📦 **Versioning Data and Models**: Learn to version your data and tuned models to track tuning experiments effectively. This lab has been implemented in **${\\textsf{\\color{red}Kubeflow}}$**\n\u003cp align=\"center\"\u003e\n\u003cimg src=\"images/3_1.png\" height=\"350\"\u003e \n\u003c/p\u003e\n\n\u003cp align=\"center\"\u003e\n\u003cimg src=\"images/3_4.png\" height=\"200\"\u003e \n\u003cimg src=\"images/3_5.png\" height=\"200\"\u003e \n\u003c/p\u003e\n\n4. ⚙️ **Configuring and Executing Supervised Tuning Pipeline**: Configure and execute an open-source supervised tuning pipeline to train and deploy a tuned LLM.\n\u003cp align=\"center\"\u003e\n\u003cimg src=\"images/4_1.png\" height=\"300\"\u003e \n\u003c/p\u003e\n\n5. 📈 **Monitoring Model Behavior**: Output and study safety scores to responsibly monitor and filter your LLM application’s behavior.\n\u003cp align=\"center\"\u003e\n\u003cimg src=\"images/4_2.png\" height=\"300\"\u003e \n\u003c/p\u003e\n\n## Key Points\n- 🛠 Adapt an open-source pipeline for supervised fine-tuning of LLMs to better answer user questions.\n- 📋 Learn best practices for versioning data and models, and pre-process large datasets inside a data warehouse.\n- 🛡️ Practice responsible AI by outputting safety scores on sub-categories of harmful content.\n\n## About the Instructor\n🌟 **Erwin Huizenga** is a Machine Learning Technical Lead at Google, bringing extensive expertise to guide you through the LLMOps pipeline.\n\n🔗 To enroll in the course or for further information, visit [deeplearning.ai](https://www.deeplearning.ai/short-courses/).\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fksm26%2Fllmops","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fksm26%2Fllmops","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fksm26%2Fllmops/lists"}