Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

awesome-llms-fine-tuning

Explore a comprehensive collection of resources, tutorials, papers, tools, and best practices for fine-tuning Large Language Models (LLMs). Perfect for ML practitioners and researchers!
https://github.com/Curated-Awesome-Lists/awesome-llms-fine-tuning

LlamaIndex
Petals - style. Fine-tuning and inference up to 10x faster than offloading. (7768 stars)
LLaMA-Factory - to-use LLM fine-tuning framework (LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, ChatGLM3). (5532 stars)
lit-gpt - of-the-art open-source LLMs based on nanoGPT. Supports flash attention, 4-bit and 8-bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed. (3469 stars)
H2O LLM Studio - code GUI for fine-tuning LLMs. Documentation: [https://h2oai.github.io/h2o-llmstudio/](https://h2oai.github.io/h2o-llmstudio/) (2880 stars)
Phoenix - Evaluate, troubleshoot, and fine tune your LLM, CV, and NLP models in a notebook. (1596 stars)
LLM-Adapters - Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models". (769 stars)
Platypus - tuning Platypus fam LLMs using LoRA. (589 stars)
xtuner - tuning LLM (InternLM, Llama, Baichuan, QWen, ChatGLM2). (540 stars)
DB-GPT-Hub - tuning techniques for DB-GPT, with the purpose of enhancing model performance, especially in Text-to-SQL, and achieved higher exec acc than GPT-4 in spider eval with 13B LLM used this project. (422 stars)
LLM-Finetuning-Hub - tuning and deployment scripts along with our research findings. :star: 416
Finetune_LLMs - tuning Casual LLMs. :star: 391
MFTCoder - task fine-tuning framework for Code LLMs; 业内首个高精度、高效率、多任务、多模型支持、多训练算法，大模型代码能力微调框架. :star: 337
llmware - grade LLM-based development framework, tools, and fine-tuned models. :star: 289
LLM-Kit
h2o-wizardlm - Source Implementation of WizardLM to turn documents into Q:A pairs for LLM fine-tuning. :star: 228
hcgf - model Fine-tuning | LLM微调. :star: 196
llm_qlora - tuning LLMs using QLoRA. :star: 136
awesome-llm-human-preference-datasets - tuning, RLHF, and eval. :star: 124
llm_finetuning - tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes). :star: 114
Fine-Tune LLMs in 2024 with Hugging Face: TRL and Flash Attention - tune LLMs (e.g., Llama 2), using hugging face trl and flash attention on consumer size GPUs (24GB).
Complete Guide to LLM Fine Tuning for Beginners - tuning a pre-trained model for new tasks, covering key concepts and providing a concrete example.
Fine-Tuning Large Language Models (LLMs) - tuning pre-trained LLMs, discussing important concepts and providing a practical example with Python code.
Creating a Domain Expert LLM: A Guide to Fine-Tuning - tuning using OpenAI's API, showcasing an example of fine-tuning a large language model for understanding the plot of a Handel opera.
A Beginner's Guide to LLM Fine-Tuning - tuning LLMs, including the use of tools like QLoRA for configuring and fine-tuning models.
Knowledge Graphs & LLMs: Fine-Tuning Vs. Retrieval-Augmented Generation - tuning them in conjunction with knowledge graphs.
Fine-tune an LLM on your personal data: create a “The Lord of the Rings” storyteller - 4.
Fine-tuning an LLM model with H2O LLM Studio to generate Cypher statements - tuning an LLM model using H2O LLM Studio for generating Cypher statements, enabling chatbot applications with knowledge graphs.
Fine-Tune Your Own Llama 2 Model in a Colab Notebook - tuning, demonstrating how to implement it in a Google Colab notebook to create your own Llama 2 model.
Thinking about fine-tuning a LLM? Here's 3 considerations before you get started - tuning LLMs, including ways to improve GPT beyond PEFT and LoRA, and the importance of investing resources wisely.
Introduction to LLMs and the generative AI : Part 3—Fine Tuning LLM with instruction - tuning them.
RAG vs Finetuning — Which Is the Best Tool to Boost Your LLM Application - A blog post discussing the aspects to consider when building LLM applications and choosing the right method for your use case. 👨‍💻
Finetuning an LLM: RLHF and alternatives (Part I) - An article showcasing alternative methods to RLHF, specifically Direct Preference Optimization (DPO). 🔄
When Should You Fine-Tune LLMs? - Exploring the comparison between fine-tuning open-source LLMs and using a closed API for LLM Queries at Scale. 🤔
Fine-Tuning Large Language Models - Considering the fine-tuning of large language models and comparing it to zero and few shot approaches. 🎯
Private GPT: Fine-Tune LLM on Enterprise Data - Exploring training techniques that allow fine-tuning LLMs on smaller GPUs. 🖥️
Fine-tune Google PaLM 2 with Scikit-LLM - Demonstrating how to fine-tune Google PaLM 2, the most advanced LLM from Google, using Scikit-LLM. 📈
A Deep-Dive into Fine-Tuning of Large Language Models - A comprehensive blog on fine-tuning LLMs like GPT-4 & BERT, providing insights, trends, and benefits. 🚀
Pre-training, fine-tuning and in-context learning in Large Language Models - Discussing the concepts of pre-training, fine-tuning, and in-context learning in LLMs. 📚
List of Open Sourced Fine-Tuned Large Language Models - A curated list of open-sourced fine-tuned LLMs that can be run locally on your computer. 📋
Practitioners guide to fine-tune LLMs for domain-specific use case - A guide covering key learnings and conclusions on fine-tuning LLMs for domain-specific use cases. 📝
Fine-Tuning Fundamentals: Unlocking the Potential of LLMs | Udemy - style models and adapting them for specific use cases.
Generative AI with Large Language Models | Coursera
Large Language Models: Application through Production | edX - centric applications using popular frameworks and achieve end-to-end production readiness.
Finetuning Large Language Models | Coursera Guided Project
OpenAI & ChatGPT API's: Expert Fine-tuning for Developers | Udemy - 3 in creating conversational AI solutions, including topics like prompt engineering, fine-tuning, integration, and deploying ChatGPT models.
Large Language Models Professional Certificate | edX
Improving the Performance of Your LLM Beyond Fine Tuning | Udemy - tuning LLM models and exploring techniques for improving their performance.
Introduction to Large Language Models | Coursera - learning course offered by Google Cloud, explaining the basics of Large Language Models (LLMs) and their use cases. Enroll for free.
Syllabus | LLM101x | edX - tune LLMs with domain-specific data to augment LLM pipelines.
Performance Tuning Deep Learning Models Master Class | Udemy
Best Large Language Models (LLMs) Courses & Certifications - tuning LLMs.
Mastering Language Models: Unleashing the Power of LLMs
LLMs Mastery: Complete Guide to Transformers & Generative AI - tuning the three major LLM models: BERT, GPT, and T5. Suitable for those interested in generative AI, LLMs, and production-level applications.
Exploring The Technologies Behind ChatGPT, GPT4 & LLMs
Non-technical Introduction to Large Language Models - technical individuals, explaining the existing challenges and providing simple explanations without complex jargon.
Large Language Models: Foundation Models from the Ground Up
Generative AI with Large Language Models — New Hands-on Course by Deeplearning.ai and AWS
From Data Selection To Fine Tuning: The Technical Guide To Constructing LLM Models
The LLM Knowledge Cookbook: From, RAG, to QLoRA, to Fine Tuning, and all the Recipes In Between!
Principles for Fine-tuning LLMs
From Data Selection To Fine Tuning: The Technical Guide To Constructing LLM Models
Hands-On Large Language Models
Fine-tune Llama 2 for text generation on Amazon SageMaker JumpStart
Fast and cost-effective LLaMA 2 fine-tuning with AWS Trainium
Fine-tuning - Advanced Deep Learning with Python [Book - tuning task following the pretraining task in advanced deep learning with Python.
The LLM Knowledge Cookbook: From, RAG, to QLoRA, to Fine ... - tuning techniques.
Quick Start Guide to Large Language Models: Strategies and Best ...
4. Advanced GPT-4 and ChatGPT Techniques - Developing Apps ... - 4 and ChatGPT, including prompt engineering, zero-shot learning, few-shot learning, and task-specific fine-tuning.
What are Large Language Models? - LLM AI Explained - AWS - shot learning and fine-tuning to improve model performance.
LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning - Adapters, an easy-to-use framework that integrates various adapters into LLMs for parameter-efficient fine-tuning (PEFT) on different tasks.
Two-stage LLM Fine-tuning with Less Specialization - stage fine-tuning framework, addresses the issue of format specialization in LLMs through Prompt Tuning with MOdel Tuning, improving their general in-context learning performance.
Fine-tuning Large Enterprise Language Models via Ontological Reasoning - specific fine-tuning of LLMs.
QLoRA: Efficient Finetuning of Quantized LLMs
Full Parameter Fine-tuning for Large Language Models with Limited Resources - memory optimization technique, enabling the full parameter fine-tuning of large LLMs with limited GPU resources.
LoRA: Low-Rank Adaptation of Large Language Models - trained models to specific tasks by injecting trainable rank decomposition matrices into each layer, reducing the number of trainable parameters while maintaining model quality.
Enhancing LLM with Evolutionary Fine Tuning for News Summary Generation
How do languages influence each other? Studying cross-lingual data sharing during LLM fine-tuning - lingual data sharing during fine-tuning of multilingual large language models (MLLMs) and analyzes the influence of different languages on model performance.
Fine-Tuning Language Models with Just Forward Passes - efficient zeroth-order optimizer, enables fine-tuning of large language models while significantly reducing the memory requirements.
Learning to Reason over Scene Graphs: A Case Study of Finetuning LLMs - 2 LLMs in robotic task planning, demonstrating the potential for using LLMs in long-horizon task planning scenarios.
Privately Fine-Tuning Large Language Models with - tuning large language models (LLMs).
DISC-LawLLM: Fine-tuning Large Language Models for Intelligent Legal Systems - LawLLM, an intelligent legal system that utilizes fine-tuned LLMs with legal reasoning capability to provide a wide range of legal services.
Multi-Task Instruction Tuning of LLaMa for Specific Scenarios: A - tuning LLaMa, a foundational LLM, on specific writing tasks, demonstrating significant improvement in writing abilities.
Training language models to follow instructions with human feedback - tuning them using human feedback, resulting in models preferred over larger models in human evaluations.
Large Language Models Can Self-Improve - improve their reasoning abilities by fine-tuning using self-generated solutions, achieving state-of-the-art performance without ground truth labels.
Embracing Large Language Models for Medical Applications - tuned LLMs in medical applications, improving diagnostic accuracy and supporting clinical decision-making.
Scaling Instruction-Finetuned Language Models - tuning on LLMs, demonstrating significant improvements in performance and generalization to unseen tasks.
Federated Fine-tuning of Billion-Sized Language Models across - tuning large LLMs on mobile devices, improving memory and time efficiency.
A Comprehensive Overview of Large Language Models
Fine-tuning language models to find agreement among humans with - tuning of a large LLM to generate consensus statements that maximize approval for a group of people with diverse opinions.
Intro to Large Language Models by Andrej Karpathy - day operating systems, and some of the security-related challenges of this new computing paradigm.
Fine-tuning Llama 2 on Your Own Dataset | Train an LLM for Your ... - tune Llama 2 model on a custom dataset.
Fine-tuning LLM with QLoRA on Single GPU: Training Falcon-7b on ... - tuning process of the Falcon 7b LLM using QLoRA.
Fine-tuning an LLM using PEFT | Introduction to Large Language ... - tune an LLM using PEFT, a technique that requires fewer resources.
LLAMA-2 Open-Source LLM: Custom Fine-tuning Made Easy on a ... - by-step guide on how to fine-tune the LLama 2 LLM model on your custom dataset.
New Course: Finetuning Large Language Models - YouTube - tuning LLMs, covering model selection, data preparation, training, and evaluation.
Q: How to create an Instruction Dataset for Fine-tuning my LLM ... - tuning LLMs, including when, how, and why to do it.
LLM Module 4: Fine-tuning and Evaluating LLMs | 4.13.1 Notebook ... - tuning and evaluating LLMs.
Google LLM Fine-Tuning/Adapting/Customizing - Getting Started ... - tuning Google's PaLM 2 large language model through a step-by-step guide.
Pretraining vs Fine-tuning vs In-context Learning of LLM (GPT-x ... - tuning, and in-context learning of LLMs like GPT-x.
How to Fine-Tune an LLM with a PDF - Langchain Tutorial - YouTube - tune OpenAI's GPT LLM to process PDF documents using Langchain and PDF libraries.
EasyTune Walkthrough - YouTube - A walkthrough of fine-tuning LLM with QLoRA on a single GPU using Falcon-7b.
Unlocking the Potential of ChatGPT Lessons in Training and Fine ... - THE STUDENT presents the instruction fine-tuning and in-context learning of LLMs with symbols.
AI News: Creating LLMs without code! - YouTube - Maya Akim discusses the top 5 LLM fine-tuning use cases you need to know.
Top 5 LLM Fine-Tuning Use Cases You Need to Know - YouTube - An in-depth video highlighting the top 5 LLM fine-tuning use cases with additional links for further exploration.
clip2 llm emory - YouTube - Learn how to fine-tune Llama 2 on your own dataset and train an LLM for your specific use case.
The EASIEST way to finetune LLAMA-v2 on a local machine! - YouTube - A step-by-step video guide demonstrating the easiest, simplest, and fastest way to fine-tune LLAMA-v2 on your local machine for a custom dataset.
Training & Fine-Tuning LLMs: Introduction - YouTube - An introduction to training and fine-tuning LLMs, including important concepts and the NeurIPS LLM Efficiency Challenge.
Fine-tuning LLMs with PEFT and LoRA - YouTube - A comprehensive video exploring how to use PEFT to fine-tune any decoder-style GPT model, including the basics of LoRA fine-tuning and uploading.
Building and Curating Datasets for RLHF and LLM Fine-tuning ... - Learn about building and curating datasets for RLHF (Reinforcement Learning from Human Feedback) and LLM (Large Language Model) fine-tuning, with sponsorship by Argilla.
Fine Tuning LLM (OpenAI GPT) with Custom Data in Python - YouTube - Explore how to extend LLM (OpenAI GPT) by fine-tuning it with a custom dataset to provide Q&A, summary, and other ChatGPT-like functions.
LLaMA Efficient Tuning - to-use LLM fine-tuning framework (LLaMA-2, BLOOM, Falcon).
H2O LLM Studio - code GUI for fine-tuning LLMs. Documentation: [https://h2oai.github.io/h2o-llmstudio/](https://h2oai.github.io/h2o-llmstudio/) (2880 stars)
PEFT - Efficient Fine-Tuning (PEFT) methods for efficient adaptation of pre-trained language models to downstream applications.
ChatGPT-like model - like model locally on your device.
Petals - style. Fine-tuning and inference up to 10x faster than offloading. (7768 stars)
NVIDIA NeMo - of-the-art conversational AI models and specifically designed for Linux. 🚀
H2O LLM Studio - code GUI for fine-tuning LLMs. Documentation: [https://h2oai.github.io/h2o-llmstudio/](https://h2oai.github.io/h2o-llmstudio/) (2880 stars)
Ludwig AI - code framework for building custom LLMs and other deep neural networks. Easily train state-of-the-art LLMs with a declarative YAML configuration file. 🤖
bert4torch - source large model weights for reasoning and fine-tuning. 🔥
Alpaca.cpp - like model locally on your device. A combination of the LLaMA foundation model and an open reproduction of Stanford Alpaca for instruction-tuned fine-tuning. 🦙
promptfoo
ML/AI Conversation: Neuro-Symbolic AI - an Alternative to LLM - This meetup will discuss the experience with fine-tuning LLMs and explore neuro-symbolic AI as an alternative.
AI Dev Day - Seattle, Mon, Oct 30, 2023, 5:00 PM - A tech talk on effective LLM observability and fine-tuning opportunities using vector similarity search.
DeepLearning.AI Events - A series of events including mitigating LLM hallucinations, fine-tuning LLMs with PyTorch 2.0 and ChatGPT, and AI education programs.
AI Dev Day - New York, Thu, Oct 26, 2023, 5:30 PM - Tech talks on best practices in GenAI applications and using LLMs for real-time, personalized notifications.
Chat LLMs & AI Agents - Use Gen AI to Build AI Systems and Agents - An event focusing on LLMs, AI agents, and chain data, with opportunities for interaction through event chat.
NYC AI/LLM/ChatGPT Developers Group - Regular tech talks/workshops for developers interested in AI, LLMs, ChatGPT, NLP, ML, Data, etc.
Leveraging LLMs for Enterprise Data, Tue, Nov 14, 2023, 2:00 PM - Dive into essential LLM strategies tailored for non-public data applications, including prompt engineering and retrieval.
Bellevue Applied Machine Learning Meetup - A meetup focusing on applied machine learning techniques and improving the skills of data scientists and ML practitioners.
AI & Prompt Engineering Meetup Munich, Do., 5. Okt. 2023, 18:15 - Introduce H2O LLM Studio for fine-tuning LLMs and bring together AI enthusiasts from various backgrounds.
Seattle AI/ML/Data Developers Group - Tech talks on evaluating LLM agents and learning AI/ML/Data through practice.
Data Science Dojo - DC | Meetup - based meetup group for business professionals interested in teaching, learning, and sharing knowledge and understanding of data science.
Find Data Science Events & Groups in Dubai, AE
AI Meetup (in-person): Generative AI and LLMs - Halloween Edition - source tools and best practices.
ChatGPT Unleashed: Live Demo and Best Practices for NLP - tuning hacks for Large Language Models and showcases the practical applications of ChatGPT and LLMs.
Find Data Science Events & Groups in Pune, IN - person events and groups related to data science in Pune, IN.
DC AI/ML/Data Developers Group | Meetup
Boston AI/LLMs/ChatGPT Developers Group | Meetup
Paris NLP | Meetup
SF AI/LLMs/ChatGPT Developers Group | Meetup
AI meetup (In-person): GenAI and LLMs for Health - related tasks.
Fine tuning large LMs - tuning large language models like GPT, BERT, and RoBERTa.
LLaMa 2.pptx
LLM.pdf - 3.
Large Language Models Bootcamp - tuning.
The LHC Explained by CNN - tuning image models.
Using Large Language Models in 10 Lines of Code
LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attention.pdf - Adapter, an efficient technique for fine-tuning language models with zero-init attention.
Intro to LLMs - tuning with prompt-completion pairs.
LLM Fine-Tuning (東大松尾研LLM講座 Day5資料) - Speaker Deck - tuning large language models, specifically for the 東大松尾研サマースクール2023.
Automate your Job and Business with ChatGPT #3
Unlocking the Power of Generative AI An Executive's Guide.pdf - A guide that explains the process of fine-tuning Large Language Models (LLMs) to tailor them to an organization's needs.
Fine tune and deploy Hugging Face NLP models | PPT - A presentation that provides insights on how to build and deploy LLM models using Hugging Face NLP.
大規模言語モデル時代のHuman-in-the-Loop機械学習 - Speaker Deck - A slide deck discussing the process of fine-tuning Language Models to find agreement among humans with diverse preferences.
AI and ML Series - Introduction to Generative AI and LLMs | PPT - A presentation introducing Generative AI and LLMs, including their usage in specific applications.
Retrieval Augmented Generation in Practice: Scalable GenAI ... - A presentation discussing use cases for Generative AI, limitations of Large Language Models, and the use of Retrieval Augmented Generation (RAG) and fine-tuning techniques.
LLM presentation final | PPT - A presentation covering the Child & Family Agency Act 2013 and the Best Interest Principle in the context of LLMs.
LLM Paradigm Adaptations in Recommender Systems.pdf - A PDF explaining the fine-tuning process and objective adaptations in LLM-based recommender systems.
Conversational AI with Transformer Models | PPT - A presentation highlighting the use of Transformer Models in Conversational AI applications.
Llama-index | PPT - A presentation on the rise of LLMs and building LLM-powered applications.
LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attention.pdf - A PDF discussing the efficient fine-tuning of Language Models with zero-init attention using LLaMA.
Practical AI: Machine Learning, Data Science - Making artificial intelligence practical, productive, and accessible to everyone. Engage in lively discussions about AI, machine learning, deep learning, neural networks, and more. Accessible insights and real-world scenarios for both beginners and seasoned practitioners.
Gradient Dissent: Exploring Machine Learning, AI, Deep Learning - Go behind the scenes to learn from industry leaders about how they are implementing deep learning in real-world scenarios. Gain insights into the machine learning industry and stay updated with the latest trends.
Weaviate Podcast - Join Connor Shorten for the Weaviate Podcast series, featuring interviews with experts and discussions on AI-related topics.
Latent Space: The AI Engineer Podcast — CodeGen, Agents, Computer Vision, Data Science, AI UX and all things Software 3.0 - Dive into the world of AI engineering, covering topics like code generation, computer vision, data science, and the latest advancements in AI UX.
Unsupervised Learning - Gain insights into the rapidly developing AI landscape and its impact on businesses and the world. Explore discussions on LLM applications, trends, and disrupting technologies.
The TWIML AI Podcast (formerly This Week in Machine Learning) - Dive deep into fine-tuning approaches used in AI, LLM capabilities and limitations, and learn from experts in the field.
AI and the Future of Work on Apple Podcasts
Practical AI: Machine Learning, Data Science: Fine-tuning vs RAG - tuning and retrieval augmented generation in machine learning and data science.
Unsupervised Learning on Apple Podcasts
Papers Read on AI | Podcast on Spotify
This Day in AI Podcast on Apple Podcasts - related topics, this podcast offers exciting insights into the world of AI.
All About Evaluating LLM Applications // Shahul Es // #179 MLOps
AI Daily on Apple Podcasts - related stories.
Yannic Kilcher Videos (Audio Only) | Podcast on Spotify
LessWrong Curated Podcast | Podcast on Spotify
SAI: The Security and AI Podcast on Apple Podcasts
Awesome List Generator - source Python package that uses the power of GPT models to automatically curate and generate starting points for resource lists related to a specific topic.

Programming Languages

Python 14 Jupyter Notebook 2

Keywords

llm 9 fine-tuning 6 large-language-models 6 gpt 5 llama 5 chatbot 4 llama2 4 ai 3 llm-training 3 machine-learning 3 nlp 3 agent 2 baichuan 2 chatglm 2 rag 2 chatgpt 2 chatglm2 2 transformers 2 peft 2 rlhf 2 qwen 2 generative-ai 2 embeddings 2 pytorch 2 falcon 2 generative 1 ai-monitoring 1 finetuning 1 ai-observability 1 ai-roi 1 clustering 1 llm-eval 1 llmops 1 ml-monitoring 1 bloom 1 deep-learning 1 distributed-systems 1 guanaco 1 language-models 1 neural-networks 1 pipeline-parallelism 1 pretrained-models 1 tensor-parallelism 1 transformer 1 volunteer-computing 1 instruction-tuning 1 language-model 1 lora 1 mistral 1 moe 1