awesome-llm-finetuning
Resources to aid your learning of LLM finetuning.
https://github.com/ushakrishnan/awesome-llm-finetuning
Last synced: 19 days ago
JSON representation
Code Samples
- **(Beginner)** Ludwig 0.8: Hands On Webinar - efficient fine-tuning techniques make training LLMs with Ludwig fast and easy |
- Fine-tuning LLMs with PEFT and LoRA - Efficient Fine-Tuning of Billion-Scale Models on Low-Resource Hardware |
- **(Beginner)** Fine-tuning OpenLLaMA-7B with QLoRA for instruction following - ift/)_| Tried and tested sample - With the availability of powerful base LLMs (e.g. LLaMA, Falcon, MPT, etc.) and instruction tuning datasets, along with the development of LoRA and QLoRA, instruction fine-tuning a base model is increasingly accessible to more people/organizations.|
- Awesome Production Machine Learning - This repository contains a curated list of awesome open source libraries that will help you deploy, monitor, version, scale and secure your production machine learning |
- Parameter-Efficient Fine-Tuning (PEFT) - tune a small number of (extra) model parameters, significantly decreasing computational and storage costs because fine-tuning large-scale PLMs is prohibitively costly. |
- QLoRA: Efficient Finetuning of Quantized LLMs - an efficient finetuning approach that reduces memory usage enough to finetune a 65B parameter model on a single 48GB GPU while preserving full 16-bit finetuning task performance |
- Ludwig - code framework for building custom LLMs, neural networks, and other AI models |
- Curated list of the best LLMOps tools for developers
Is (efficient) LLM Finetuning the key to production ready solutions?
- Generative AI — LLMOps Architecture Patterns
- 
Reading Materials
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG, Fine-tuning or Both? - tuning or Both? A Complete Framework for Choosing the Right Strategy |
- Parameter-Efficient Fine-Tuning (PEFT) - tune a small number of (extra) model parameters, significantly decreasing computational and storage costs because fine-tuning large-scale PLMs is prohibitively costly. |
- Ludwig - Declarative deep learning framework - ai/ludwig) Code sample_| Declarative deep learning framework built for scale and efficiency. Ludwig is a low-code framework for building custom AI models like LLMs and other deep neural networks. Learn when and how to use Ludwig! |
- Fine-tuning OpenLLaMA-7B with QLoRA for instruction following - With the availability of powerful base LLMs (e.g. LLaMA, Falcon, MPT, etc.) and instruction tuning datasets, along with the development of LoRA and QLoRA, instruction fine-tuning a base model is increasingly accessible to more people/organizations.|
- Personal Copilot: Train Your Own Coding Assistant - LLM-Workshop/tree/main/personal_copilot/training)_ | In this blog post we show how we created HugCoder, a code LLM fine-tuned on the code contents from the public repositories of the huggingface GitHub organization. |
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- Optimizing LLMs - by-Step Guide to Fine-Tuning with PEFT and QLoRA (A Practical Guide to Fine-Tuning LLM using QLora) |
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- A guide to parameter efficient fine-tuning (PEFT) - tune LLMs on downstream tasks.|
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- Fine-tuning OpenLLaMA-7B with QLoRA for instruction following - With the availability of powerful base LLMs (e.g. LLaMA, Falcon, MPT, etc.) and instruction tuning datasets, along with the development of LoRA and QLoRA, instruction fine-tuning a base model is increasingly accessible to more people/organizations.|
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
- **(Beginner)** RAG vs Finetuning
Videos
- Ludwig: A Toolbox for Training and Testing Deep Learning Models without Writing Code
- Efficient Fine-Tuning for Llama-v2-7b on a Single GPU - 2 on for their own projects.
- Efficiently Build Custom LLMs on Your Data with Open-source Ludwig
- Introduction to Ludwig - multi-model sample
- **(Beginner)** Build Your Own LLM in Less Than 10 Lines of YAML (Predibase) - How declarative ML simplifies model building and training; How to use off-the-shelf pretrained LLMs with Ludwig - the open-source declarative ML framework from Uber ; How to rapidly fine-tune an LLM on your data in less than 10 lines of code with Ludwig using parameter efficient methods, deepspeed and Ray |