{"id":13467653,"url":"https://github.com/decodingml/llm-twin-course","last_synced_at":"2025-05-13T21:12:12.908Z","repository":{"id":227103532,"uuid":"769066911","full_name":"decodingml/llm-twin-course","owner":"decodingml","description":"🤖 𝗟𝗲𝗮𝗿𝗻 for 𝗳𝗿𝗲𝗲 how to 𝗯𝘂𝗶𝗹𝗱 an end-to-end 𝗽𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝗼𝗻-𝗿𝗲𝗮𝗱𝘆 𝗟𝗟𝗠 \u0026 𝗥𝗔𝗚 𝘀𝘆𝘀𝘁𝗲𝗺 using 𝗟𝗟𝗠𝗢𝗽𝘀 best practices: ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 12 𝘩𝘢𝘯𝘥𝘴-𝘰𝘯 𝘭𝘦𝘴𝘴𝘰𝘯𝘴","archived":false,"fork":false,"pushed_at":"2025-04-26T14:11:47.000Z","size":10254,"stargazers_count":3840,"open_issues_count":4,"forks_count":636,"subscribers_count":74,"default_branch":"main","last_synced_at":"2025-04-29T13:05:08.992Z","etag":null,"topics":["aws","bytewax","comet-ml","course","docker","generative-ai","infrastructure-as-code","large-language-models","llmops","machine-learning-engineering","ml-system-design","mlops","pulumi","qdrant","qwak","rag","superlinked"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/decodingml.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2024-03-08T09:21:28.000Z","updated_at":"2025-04-29T01:32:12.000Z","dependencies_parsed_at":"2024-03-11T17:14:25.091Z","dependency_job_id":"46c32fe4-41e8-4a27-ac0c-1c2a60a2237c","html_url":"https://github.com/decodingml/llm-twin-course","commit_stats":null,"previous_names":["decodingml/llm-twin-course"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/decodingml%2Fllm-twin-course","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/decodingml%2Fllm-twin-course/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/decodingml%2Fllm-twin-course/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/decodingml%2Fllm-twin-course/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/decodingml","download_url":"https://codeload.github.com/decodingml/llm-twin-course/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":251583640,"owners_count":21612875,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["aws","bytewax","comet-ml","course","docker","generative-ai","infrastructure-as-code","large-language-models","llmops","machine-learning-engineering","ml-system-design","mlops","pulumi","qdrant","qwak","rag","superlinked"],"created_at":"2024-07-31T15:00:58.939Z","updated_at":"2025-05-13T21:12:07.896Z","avatar_url":"https://github.com/decodingml.png","language":"Python","readme":"\u003cdiv align=\"center\"\u003e\n    \u003ch2\u003eLLM Twin Course: Building Your Production-Ready AI Replica\u003c/h2\u003e\n    \u003ch1\u003eLearn to architect and implement a production-ready LLM \u0026 RAG system by building your LLM Twin\u003c/h1\u003e\n    \u003ch3\u003eFrom data gathering to productionizing LLMs using LLMOps good practices.\u003c/h3\u003e\n    \u003ci\u003eby \u003ca href=\"https://decodingml.substack.com\"\u003eDecoding ML\u003c/i\u003e\n\u003c/div\u003e\n\n\u003c/br\u003e\n\n\u003cp align=\"center\"\u003e\n  \u003cimg src=\"media/cover.png\" alt=\"Your image description\"\u003e\n\u003c/p\u003e\n\n## 🎯 What you'll learn\n\n*By finishing the **\"LLM Twin: Building Your Production-Ready AI Replica\"** free course, you will learn how to design, train, and deploy a production-ready LLM twin of yourself powered by LLMs, vector DBs, and LLMOps good practices.*\n\n**No more isolated scripts or Notebooks!** Learn production ML by building and deploying an end-to-end production-grade LLM system.\n\n## 📖 About this course\n\nYou will **learn** how to **architect** and **build a real-world LLM system** from **start** to **finish** - from **data collection** to **deployment**.\n\nYou will also **learn** to **leverage MLOps best practices**, such as experiment trackers, model registries, prompt monitoring, and versioning.\n\n**The end goal?** Build and deploy your own LLM twin.\n\n**What is an LLM Twin?** It is an AI character that learns to write like somebody by incorporating its style and personality into an LLM.\n\n## 🪈 The architecture of the LLM Twin is split into 4 Python microservices\n\n\u003cp align=\"center\"\u003e\n  \u003cimg src=\"media/architecture.png\" alt=\"LLM Twin Architecture\"\u003e\n\u003c/p\u003e\n\n### The data collection pipeline\n\n- Crawl your digital data from various social media platforms, such as Medium, Substack and GitHub.\n- Clean, normalize and load the data to a [Mongo NoSQL DB](https://www.mongodb.com/) through a series of ETL pipelines.\n- Send database changes to a [RabbitMQ](https://www.rabbitmq.com/) queue using the CDC pattern.\n- Learn to package the crawlers as AWS Lambda functions.\n\n### The feature pipeline\n\n- Consume messages in real-time from a queue through a [Bytewax](https://github.com/bytewax/bytewax?utm_source=github\u0026utm_medium=decodingml\u0026utm_campaign=2024_q1) streaming pipeline.\n- Every message will be cleaned, chunked, embedded and loaded into a [Qdrant](https://qdrant.tech/?utm_source=decodingml\u0026utm_medium=referral\u0026utm_campaign=llm-course) vector DB.\n- In the bonus series, we refactor the cleaning, chunking, and embedding logic using [Superlinked](https://github.com/superlinked/superlinked?utm_source=community\u0026utm_medium=github\u0026utm_campaign=oscourse), a specialized vector compute engine. We will also load and index the vectors to a [Redis vector DB](https://redis.io/solutions/vector-search/).\n\n### The training pipeline\n\n- Create a custom instruction dataset based on your custom digital data to do SFT.\n- Fine-tune an LLM using LoRA or QLoRA.\n- Use [Comet ML's](https://www.comet.com/signup/?utm_source=decoding_ml\u0026utm_medium=partner\u0026utm_content=github) experiment tracker to monitor the experiments.\n- Evaluate the LLM using [Opik](https://github.com/comet-ml/opik)\n- Save and version the best model to the [Hugging Face model registry](https://huggingface.co/models).\n- Run and automate the training pipeline using [AWS SageMaker](https://aws.amazon.com/sagemaker/).\n\n### The inference pipeline\n\n- Load the fine-tuned LLM from the [Hugging Face model registry](https://huggingface.co/models).\n- Deploy the LLM as a scalable REST API using [AWS SageMaker inference endpoints](https://aws.amazon.com/sagemaker/deploy/).\n- Enhance the prompts using advanced RAG techniques.\n- Monitor the prompts and LLM generated results using [Opik](https://github.com/comet-ml/opik)\n- In the bonus series, we refactor the advanced RAG layer to write more optimal queries using [Superlinked](https://github.com/superlinked/superlinked?utm_source=community\u0026utm_medium=github\u0026utm_campaign=oscourse).\n- Wrap up everything with a Gradio UI (as seen below) where you can start playing around with the LLM Twin to generate content that follows your writing style.\n\n\u003cp align=\"center\"\u003e\n  \u003cimg src=\"media/ui-example.png\" alt=\"Gradio UI\"\u003e\n\u003c/p\u003e\n\nAlong the 4 microservices, you will learn to integrate 4 serverless tools:\n\n* [Comet ML](https://www.comet.com/signup/?utm_source=decoding_ml\u0026utm_medium=partner\u0026utm_content=github) as your experiment tracker and data registry;\n* [Qdrant](https://qdrant.tech/?utm_source=decodingml\u0026utm_medium=referral\u0026utm_campaign=llm-course) as your vector DB;\n* [AWS SageMaker](https://aws.amazon.com/sagemaker/) as your ML infrastructure;\n* [Opik](https://github.com/comet-ml/opik) as your prompt evaluation and monitoring tool.\n\n----\n\n\u003ctable style=\"border-collapse: collapse; border: none;\"\u003e\n  \u003ctr style=\"border: none;\"\u003e\n    \u003ctd width=\"20%\" style=\"border: none;\"\u003e\n      \u003ca href=\"https://decodingml.substack.com/\" aria-label=\"Decoding ML\"\u003e\n        \u003cimg src=\"https://github.com/user-attachments/assets/f2f2f9c0-54b7-4ae3-bf8d-23a359c86982\" alt=\"Decoding ML Logo\" width=\"150\"/\u003e\n      \u003c/a\u003e\n    \u003c/td\u003e\n    \u003ctd width=\"80%\" style=\"border: none;\"\u003e\n      \u003cdiv\u003e\n        \u003ch2\u003e📬 Stay Updated\u003c/h2\u003e\n        \u003cp\u003e\u003cb\u003e\u003ca href=\"https://decodingml.substack.com/\"\u003eJoin Decoding ML\u003c/a\u003e\u003c/b\u003e for proven content on designing, coding, and deploying production-grade AI systems with software engineering and MLOps best practices to help you ship AI applications. Every week, straight to your inbox.\u003c/p\u003e\n      \u003c/div\u003e\n    \u003c/td\u003e\n  \u003c/tr\u003e\n\u003c/table\u003e\n\n\u003cp align=\"center\"\u003e\n  \u003ca href=\"https://decodingml.substack.com/\"\u003e\n    \u003cimg src=\"https://img.shields.io/static/v1?label\u0026logo=substack\u0026message=Subscribe%20Now\u0026style=for-the-badge\u0026color=black\u0026scale=2\" alt=\"Subscribe Now\" height=\"40\"\u003e\n  \u003c/a\u003e\n\u003c/p\u003e\n\n## 👥 Who should join?\n\n**This course is ideal for:**\n- ML/AI engineers who want to learn to engineer production-ready LLM \u0026 RAG systems using LLMOps good principles\n- Data Engineers, Data Scientists, and Software Engineers wanting to understand the engineering behind LLM \u0026 RAG systems\n\n**Note:** This course focuses on engineering practices and end-to-end system implementation rather than theoretical model optimization or research.\n\n## 🎓 Prerequisites\n\n| Category | Requirements |\n|----------|-------------|\n| **Skills** | Basic understanding of Python and Machine Learning |\n| **Hardware** | Any modern laptop/workstation will do the job, as the LLM fine-tuning and inference will be done on AWS SageMaker. |\n| **Level** | Intermediate |\n\n## 💰 Cost structure\n\nAll tools used throughout the course will stick to their free tier, except:\n\n- OpenAI's API, which will cost ~$1\n- AWS for fine-tuning and inference, which will cost \u003c $10 depending on how much you play around with our scripts and your region.\n\n## 🥂 Open-source course: Participation is open and Free\n\nAs an open-source course, you don't have to enroll. Everything is self-paced, free of charge and with its resources freely accessible as follows:\n- **code**: this GitHub repository\n- **articles**: [Decoding ML](https://medium.com/decodingml/llm-twin-course/home)\n\n## 📚 How will you learn?\n\nThe course contains **10 hands-on written lessons** and the **open-source code** you can access on GitHub, showing how to build an end-to-end LLM system.\n\nAlso, it includes **2 bonus lessons** on how to **improve the RAG system**.\n\nYou can read everything at your own pace.\n\n## Lessons\n\nThis self-paced course consists of 12 comprehensive lessons covering theory, system design, and hands-on implementation.\n\nOur recommendation for each module:\n1. Read the article\n2. Run the code to replicate our results\n3. Go deeper into the code by reading the `src` Python modules\n\n\u003e [!NOTE]\n\u003e Check the [INSTALL_AND_USAGE](https://github.com/decodingml/llm-twin-course/blob/main/INSTALL_AND_USAGE.md) doc for a step-by-step installation and usage guide.\n\n| Lesson | Article | Category | Description | Source Code |\n|--------|---------|----------|-------------|-------------|\n| 1 | [An End-to-End Framework for Production-Ready LLM Systems](https://medium.com/decodingml/an-end-to-end-framework-for-production-ready-llm-systems-by-building-your-llm-twin-2cc6bb01141f) | System Design | Learn the overall architecture and design principles of production LLM systems. | No code |\n| 2 | [Data Crawling](https://medium.com/decodingml/your-content-is-gold-i-turned-3-years-of-blog-posts-into-an-llm-training-d19c265bdd6e) | Data Engineering | Learn to crawl and process social media content for LLM training. | `src/data_crawling` |\n| 3 | [CDC Magic](https://medium.com/decodingml/i-replaced-1000-lines-of-polling-code-with-50-lines-of-cdc-magic-4d31abd3bc3b) | Data Engineering | Learn to implement Change Data Capture (CDC) for syncing two data sources. | `src/data_cdc` |\n| 4 | [Feature Streaming Pipelines](https://medium.com/decodingml/sota-python-streaming-pipelines-for-fine-tuning-llms-and-rag-in-real-time-82eb07795b87) | Feature Pipeline | Build real-time streaming pipelines for LLM and RAG data processing. | `src/feature_pipeline` |\n| 5 | [Advanced RAG Algorithms](https://medium.com/decodingml/the-4-advanced-rag-algorithms-you-must-know-to-implement-5d0c7f1199d2) | Feature Pipeline | Implement advanced RAG techniques for better retrieval. | `src/feature_pipeline` |\n| 6 | [Generate Fine-Tuning Instruct Datasets](https://medium.com/decodingml/turning-raw-data-into-fine-tuning-datasets-dc83657d1280) | Training Pipeline | Create custom instruct datasets for LLM fine-tuning. | `src/feature_pipeline/generate_dataset` |\n| 7 | [LLM Fine-tuning Pipeline](https://medium.com/decodingml/8b-parameters-1-gpu-no-problems-the-ultimate-llm-fine-tuning-pipeline-f68ef6c359c2) | Training Pipeline | Build an end-to-end LLM fine-tuning pipeline and deploy it to AWS SageMaker. | `src/training_pipeline` |\n| 8 | [LLM \u0026 RAG Evaluation](https://medium.com/decodingml/the-engineers-framework-for-llm-rag-evaluation-59897381c326) | Training Pipeline | Learn to evaluate LLM and RAG system performance. | `src/inference_pipeline/evaluation` |\n| 9 | [Implement and Deploy the RAG Inference Pipeline](https://medium.com/decodingml/beyond-proof-of-concept-building-rag-systems-that-scale-e537d0eb063a) | Inference Pipeline | Design,  implement and deploy the RAG inference to AWS SageMaker. | `src/inference_pipeline` |\n| 10 | [Prompt Monitoring](https://medium.com/decodingml/the-ultimate-prompt-monitoring-pipeline-886cbb75ae25) | Inference Pipeline | Build the prompt monitoring and production evaluation pipeline. | `src/inference_pipeline` |\n| 11 | [Refactor the RAG module using 74.3% Less Code ](https://medium.com/decodingml/build-a-scalable-rag-ingestion-pipeline-using-74-3-less-code-ac50095100d6) | Bonus on RAG | Optimize the RAG system. | `src/bonus_superlinked_rag` |\n| 12 | [Multi-Index RAG Apps](https://medium.com/decodingml/build-multi-index-advanced-rag-apps-bd33d2f0ec5c) | Bonus on RAG | Build advanced multi-index RAG apps. | `src/bonus_superlinked_rag` |\n\n----\n\n\u003ctable style=\"border-collapse: collapse; border: none;\"\u003e\n  \u003ctr style=\"border: none;\"\u003e\n    \u003ctd width=\"20%\" style=\"border: none;\"\u003e\n      \u003ca href=\"https://decodingml.substack.com/\" aria-label=\"Decoding ML\"\u003e\n        \u003cimg src=\"https://github.com/user-attachments/assets/f2f2f9c0-54b7-4ae3-bf8d-23a359c86982\" alt=\"Decoding ML Logo\" width=\"150\"/\u003e\n      \u003c/a\u003e\n    \u003c/td\u003e\n    \u003ctd width=\"80%\" style=\"border: none;\"\u003e\n      \u003cdiv\u003e\n        \u003ch2\u003e📬 Stay Updated\u003c/h2\u003e\n        \u003cp\u003e\u003cb\u003e\u003ca href=\"https://decodingml.substack.com/\"\u003eJoin Decoding ML\u003c/a\u003e\u003c/b\u003e for proven content on designing, coding, and deploying production-grade AI systems with software engineering and MLOps best practices to help you ship AI applications. Every week, straight to your inbox.\u003c/p\u003e\n      \u003c/div\u003e\n    \u003c/td\u003e\n  \u003c/tr\u003e\n\u003c/table\u003e\n\n\u003cp align=\"center\"\u003e\n  \u003ca href=\"https://decodingml.substack.com/\"\u003e\n    \u003cimg src=\"https://img.shields.io/static/v1?label\u0026logo=substack\u0026message=Subscribe%20Now\u0026style=for-the-badge\u0026color=black\u0026scale=2\" alt=\"Subscribe Now\" height=\"40\"\u003e\n  \u003c/a\u003e\n\u003c/p\u003e\n\n## 🏗️ Project Structure\n\nAt Decoding ML we teach how to build production ML systems, thus the course follows the structure of a real-world Python project:\n\n```text\nllm-twin-course/\n├── src/                     # Source code for all the ML pipelines and services\n│ ├── data_crawling/         # Data collection pipeline code\n│ ├── data_cdc/              # Change Data Capture (CDC) pipeline code\n│ ├── feature_pipeline/      # Feature engineering pipeline code\n│ ├── training_pipeline/     # Training pipeline code\n│ ├── inference_pipeline/    # Inference service code\n│ └── bonus_superlinked_rag/ # Bonus RAG optimization code\n├── .env.example             # Example environment variables template\n├── Makefile                 # Commands to build and run the project\n├── pyproject.toml           # Project dependencies\n```\n\n\n## 🚀 Install \u0026 Usage\n\nTo understand how to **install and run the LLM Twin code end-to-end**, go to the [INSTALL_AND_USAGE](https://github.com/decodingml/llm-twin-course/blob/main/INSTALL_AND_USAGE.md) dedicated document.\n\n\u003e [!NOTE]\n\u003e Even though you can run everything solely using the [INSTALL_AND_USAGE](https://github.com/decodingml/llm-twin-course/blob/main/INSTALL_AND_USAGE.md) dedicated document, we recommend that you read the articles to understand the LLM Twin system and design choices fully.\n\n\n## 💡 Questions and troubleshooting\n\nHave questions or running into issues? We're here to help!\n\nOpen a [GitHub issue](https://github.com/decodingml/llm-twin-course/issues) for:\n- Questions about the course material\n- Technical troubleshooting\n- Clarification on concepts\n\n\n## 🥂 Contributing\n\nAs an open-source course, we may not be able to fix all the bugs that arise.\n\nIf you find any bugs and know how to fix them, support future readers by contributing to this course with your bug fix.\n\nWe will deeply appreciate your support for the AI community and future readers 🤗\n\n\n## Contributors\n\nA big \"Thank you 🙏\" to all our contributors! This course is possible only because of their efforts.\n\n\u003cp align=\"center\"\u003e\n    \u003ca href=\"https://github.com/decodingml/llm-twin-course/graphs/contributors\"\u003e\n      \u003cimg src=\"https://contrib.rocks/image?repo=decodingml/llm-twin-course\" /\u003e\n    \u003c/a\u003e\n\u003c/p\u003e\n\n## Sponsors\n\nAlso, another big \"Thank you 🙏\" to all our sponsors who supported our work and made this course possible. \n\n\u003ctable\u003e\n  \u003ctr\u003e\n    \u003ctd align=\"center\"\u003e\n      \u003ca href=\"https://www.comet.com/signup/?utm_source=decoding_ml\u0026utm_medium=partner\u0026utm_content=github\" target=\"_blank\"\u003eComet\u003c/a\u003e\n    \u003c/td\u003e\n    \u003ctd align=\"center\"\u003e\n      \u003ca href=\"https://github.com/comet-ml/opik\" target=\"_blank\"\u003eOpik\u003c/a\u003e\n    \u003c/td\u003e\n    \u003ctd align=\"center\"\u003e\n      \u003ca href=\"https://github.com/bytewax/bytewax?utm_source=github\u0026utm_medium=decodingml\u0026utm_campaign=2024_q1\" target=\"_blank\"\u003eBytewax\u003c/a\u003e\n    \u003c/td\u003e\n    \u003ctd align=\"center\"\u003e\n      \u003ca href=\"https://qdrant.tech/?utm_source=decodingml\u0026utm_medium=referral\u0026utm_campaign=llm-course\" target=\"_blank\"\u003eQdrant\u003c/a\u003e\n    \u003c/td\u003e\n    \u003ctd align=\"center\"\u003e\n      \u003ca href=\"https://github.com/superlinked/superlinked?utm_source=community\u0026utm_medium=github\u0026utm_campaign=oscourse\" target=\"_blank\"\u003eSuperlinked\u003c/a\u003e\n    \u003c/td\u003e\n  \u003c/tr\u003e\n  \u003ctr\u003e\n    \u003ctd align=\"center\"\u003e\n      \u003ca href=\"https://www.comet.com/signup/?utm_source=decoding_ml\u0026utm_medium=partner\u0026utm_content=github\" target=\"_blank\"\u003e\n        \u003cimg src=\"media/sponsors/comet.png\" width=\"150\" alt=\"Comet\"\u003e\n      \u003c/a\u003e\n    \u003c/td\u003e\n    \u003ctd align=\"center\"\u003e\n      \u003ca href=\"https://github.com/comet-ml/opik\" target=\"_blank\"\u003e\n        \u003cimg src=\"media/sponsors/opik.svg\" width=\"150\" alt=\"Opik\"\u003e\n      \u003c/a\u003e\n    \u003c/td\u003e\n    \u003ctd align=\"center\"\u003e\n      \u003ca href=\"https://github.com/bytewax/bytewax?utm_source=github\u0026utm_medium=decodingml\u0026utm_campaign=2024_q1\" target=\"_blank\"\u003e\n        \u003cimg src=\"media/sponsors/bytewax.png\" width=\"150\" alt=\"Bytewax\"\u003e\n      \u003c/a\u003e\n    \u003c/td\u003e\n    \u003ctd align=\"center\"\u003e\n      \u003ca href=\"https://qdrant.tech/?utm_source=decodingml\u0026utm_medium=referral\u0026utm_campaign=llm-course\" target=\"_blank\"\u003e\n        \u003cimg src=\"media/sponsors/qdrant.svg\" width=\"150\" alt=\"Qdrant\"\u003e\n      \u003c/a\u003e\n    \u003c/td\u003e\n    \u003ctd align=\"center\"\u003e\n      \u003ca href=\"https://github.com/superlinked/superlinked?utm_source=community\u0026utm_medium=github\u0026utm_campaign=oscourse\" target=\"_blank\"\u003e\n        \u003cimg src=\"media/sponsors/superlinked.svg\" width=\"150\" alt=\"Superlinked\"\u003e\n      \u003c/a\u003e\n    \u003c/td\u003e\n  \u003c/tr\u003e\n\u003c/table\u003e\n\n## Next steps\n\nOur **LLM Engineer’s Handbook** inspired the **open-source LLM Twin course**.\n\nConsider supporting our work by getting our book to **learn** a **complete framework** for **building and deploying production LLM \u0026 RAG systems** — from data to deployment.\n\nPerfect for practitioners who want **both theory** and **hands-on** expertise by connecting the dots between DE, research, MLE and MLOps:\n\n**[Buy the LLM Engineer’s Handbook](https://www.amazon.com/LLM-Engineers-Handbook-engineering-production/dp/1836200072/)**\n\n* [On Amazon](https://www.amazon.com/LLM-Engineers-Handbook-engineering-production/dp/1836200072/)\n* [On Packt](https://www.packtpub.com/en-us/product/llm-engineers-handbook-9781836200062)\n\n\u003cp align=\"center\"\u003e\n  \u003ca href=\"https://www.amazon.com/LLM-Engineers-Handbook-engineering-production/dp/1836200072/\"\u003e\n    \u003cimg src=\"media/llm_engineers_handbook_cover.png\" alt=\"LLM Engineer's Handbook\"\u003e\n  \u003c/a\u003e\n\u003c/p\u003e\n\n## License\n\nThis course is an open-source project released under the MIT license. Thus, as long you distribute our LICENSE and acknowledge our work, you can safely clone or fork this project and use it as a source of inspiration for whatever you want (e.g., university projects, college degree projects, personal projects, etc.).\n\n----\n\n\u003ctable style=\"border-collapse: collapse; border: none;\"\u003e\n  \u003ctr style=\"border: none;\"\u003e\n    \u003ctd width=\"20%\" style=\"border: none;\"\u003e\n      \u003ca href=\"https://decodingml.substack.com/\" aria-label=\"Decoding ML\"\u003e\n        \u003cimg src=\"https://github.com/user-attachments/assets/f2f2f9c0-54b7-4ae3-bf8d-23a359c86982\" alt=\"Decoding ML Logo\" width=\"150\"/\u003e\n      \u003c/a\u003e\n    \u003c/td\u003e\n    \u003ctd width=\"80%\" style=\"border: none;\"\u003e\n      \u003cdiv\u003e\n        \u003ch2\u003e📬 Stay Updated\u003c/h2\u003e\n        \u003cp\u003e\u003cb\u003e\u003ca href=\"https://decodingml.substack.com/\"\u003eJoin Decoding ML\u003c/a\u003e\u003c/b\u003e for proven content on designing, coding, and deploying production-grade AI systems with software engineering and MLOps best practices to help you ship AI applications. Every week, straight to your inbox.\u003c/p\u003e\n      \u003c/div\u003e\n    \u003c/td\u003e\n  \u003c/tr\u003e\n\u003c/table\u003e\n\n\u003cp align=\"center\"\u003e\n  \u003ca href=\"https://decodingml.substack.com/\"\u003e\n    \u003cimg src=\"https://img.shields.io/static/v1?label\u0026logo=substack\u0026message=Subscribe%20Now\u0026style=for-the-badge\u0026color=black\u0026scale=2\" alt=\"Subscribe Now\" height=\"40\"\u003e\n  \u003c/a\u003e\n\u003c/p\u003e\n","funding_links":[],"categories":["Python","A01_文本生成_文本对话","LLM Courses / Education"],"sub_categories":["大语言对话模型及数据"],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdecodingml%2Fllm-twin-course","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdecodingml%2Fllm-twin-course","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdecodingml%2Fllm-twin-course/lists"}