Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

awesome-llms-fine-tuning

Explore a comprehensive collection of resources, tutorials, papers, tools, and best practices for fine-tuning Large Language Models (LLMs). Perfect for ML practitioners and researchers!
https://github.com/Curated-Awesome-Lists/awesome-llms-fine-tuning

Last synced: 3 days ago
JSON representation

Articles & Blogs
- Fine-Tuning Large Language Models (LLMs) - tuning pre-trained LLMs, discussing important concepts and providing a practical example with Python code.
- A Beginner's Guide to LLM Fine-Tuning - tuning LLMs, including the use of tools like QLoRA for configuring and fine-tuning models.
- Fine-tuning an LLM model with H2O LLM Studio to generate Cypher statements - tuning an LLM model using H2O LLM Studio for generating Cypher statements, enabling chatbot applications with knowledge graphs.
- Fine-Tune Your Own Llama 2 Model in a Colab Notebook - tuning, demonstrating how to implement it in a Google Colab notebook to create your own Llama 2 model.
- Thinking about fine-tuning a LLM? Here's 3 considerations before you get started - tuning LLMs, including ways to improve GPT beyond PEFT and LoRA, and the importance of investing resources wisely.
- RAG vs Finetuning — Which Is the Best Tool to Boost Your LLM Application - A blog post discussing the aspects to consider when building LLM applications and choosing the right method for your use case. 👨‍💻
- When Should You Fine-Tune LLMs? - Exploring the comparison between fine-tuning open-source LLMs and using a closed API for LLM Queries at Scale. 🤔
- Private GPT: Fine-Tune LLM on Enterprise Data - Exploring training techniques that allow fine-tuning LLMs on smaller GPUs. 🖥️
- Fine-Tuning Large Language Models (LLMs) - tuning pre-trained LLMs, discussing important concepts and providing a practical example with Python code.
- A Beginner's Guide to LLM Fine-Tuning - tuning LLMs, including the use of tools like QLoRA for configuring and fine-tuning models.
- Fine-tuning an LLM model with H2O LLM Studio to generate Cypher statements - tuning an LLM model using H2O LLM Studio for generating Cypher statements, enabling chatbot applications with knowledge graphs.
- Fine-Tune Your Own Llama 2 Model in a Colab Notebook - tuning, demonstrating how to implement it in a Google Colab notebook to create your own Llama 2 model.
- Thinking about fine-tuning a LLM? Here's 3 considerations before you get started - tuning LLMs, including ways to improve GPT beyond PEFT and LoRA, and the importance of investing resources wisely.
- RAG vs Finetuning — Which Is the Best Tool to Boost Your LLM Application - A blog post discussing the aspects to consider when building LLM applications and choosing the right method for your use case. 👨‍💻
- When Should You Fine-Tune LLMs? - Exploring the comparison between fine-tuning open-source LLMs and using a closed API for LLM Queries at Scale. 🤔
- Private GPT: Fine-Tune LLM on Enterprise Data - Exploring training techniques that allow fine-tuning LLMs on smaller GPUs. 🖥️
- Fine-Tuning Large Language Models (LLMs) - tuning pre-trained LLMs, discussing important concepts and providing a practical example with Python code.
- A Beginner's Guide to LLM Fine-Tuning - tuning LLMs, including the use of tools like QLoRA for configuring and fine-tuning models.
- Fine-tuning an LLM model with H2O LLM Studio to generate Cypher statements - tuning an LLM model using H2O LLM Studio for generating Cypher statements, enabling chatbot applications with knowledge graphs.
- Fine-Tune Your Own Llama 2 Model in a Colab Notebook - tuning, demonstrating how to implement it in a Google Colab notebook to create your own Llama 2 model.
- Thinking about fine-tuning a LLM? Here's 3 considerations before you get started - tuning LLMs, including ways to improve GPT beyond PEFT and LoRA, and the importance of investing resources wisely.
- RAG vs Finetuning — Which Is the Best Tool to Boost Your LLM Application - A blog post discussing the aspects to consider when building LLM applications and choosing the right method for your use case. 👨‍💻
- When Should You Fine-Tune LLMs? - Exploring the comparison between fine-tuning open-source LLMs and using a closed API for LLM Queries at Scale. 🤔
- Private GPT: Fine-Tune LLM on Enterprise Data - Exploring training techniques that allow fine-tuning LLMs on smaller GPUs. 🖥️
- Fine-Tuning Large Language Models (LLMs) - tuning pre-trained LLMs, discussing important concepts and providing a practical example with Python code.
- A Beginner's Guide to LLM Fine-Tuning - tuning LLMs, including the use of tools like QLoRA for configuring and fine-tuning models.
- Fine-tuning an LLM model with H2O LLM Studio to generate Cypher statements - tuning an LLM model using H2O LLM Studio for generating Cypher statements, enabling chatbot applications with knowledge graphs.
- Fine-Tune Your Own Llama 2 Model in a Colab Notebook - tuning, demonstrating how to implement it in a Google Colab notebook to create your own Llama 2 model.
- Thinking about fine-tuning a LLM? Here's 3 considerations before you get started - tuning LLMs, including ways to improve GPT beyond PEFT and LoRA, and the importance of investing resources wisely.
- RAG vs Finetuning — Which Is the Best Tool to Boost Your LLM Application - A blog post discussing the aspects to consider when building LLM applications and choosing the right method for your use case. 👨‍💻
- When Should You Fine-Tune LLMs? - Exploring the comparison between fine-tuning open-source LLMs and using a closed API for LLM Queries at Scale. 🤔
- Private GPT: Fine-Tune LLM on Enterprise Data - Exploring training techniques that allow fine-tuning LLMs on smaller GPUs. 🖥️
- Fine-Tuning Large Language Models (LLMs) - tuning pre-trained LLMs, discussing important concepts and providing a practical example with Python code.
- A Beginner's Guide to LLM Fine-Tuning - tuning LLMs, including the use of tools like QLoRA for configuring and fine-tuning models.
- Fine-tuning an LLM model with H2O LLM Studio to generate Cypher statements - tuning an LLM model using H2O LLM Studio for generating Cypher statements, enabling chatbot applications with knowledge graphs.
- Fine-Tune Your Own Llama 2 Model in a Colab Notebook - tuning, demonstrating how to implement it in a Google Colab notebook to create your own Llama 2 model.
- Thinking about fine-tuning a LLM? Here's 3 considerations before you get started - tuning LLMs, including ways to improve GPT beyond PEFT and LoRA, and the importance of investing resources wisely.
- When Should You Fine-Tune LLMs? - Exploring the comparison between fine-tuning open-source LLMs and using a closed API for LLM Queries at Scale. 🤔
- Private GPT: Fine-Tune LLM on Enterprise Data - Exploring training techniques that allow fine-tuning LLMs on smaller GPUs. 🖥️
- Fine-Tuning Large Language Models (LLMs) - tuning pre-trained LLMs, discussing important concepts and providing a practical example with Python code.
- A Beginner's Guide to LLM Fine-Tuning - tuning LLMs, including the use of tools like QLoRA for configuring and fine-tuning models.
- Fine-tuning an LLM model with H2O LLM Studio to generate Cypher statements - tuning an LLM model using H2O LLM Studio for generating Cypher statements, enabling chatbot applications with knowledge graphs.
- Fine-Tune Your Own Llama 2 Model in a Colab Notebook - tuning, demonstrating how to implement it in a Google Colab notebook to create your own Llama 2 model.
- Thinking about fine-tuning a LLM? Here's 3 considerations before you get started - tuning LLMs, including ways to improve GPT beyond PEFT and LoRA, and the importance of investing resources wisely.
- RAG vs Finetuning — Which Is the Best Tool to Boost Your LLM Application - A blog post discussing the aspects to consider when building LLM applications and choosing the right method for your use case. 👨‍💻
- When Should You Fine-Tune LLMs? - Exploring the comparison between fine-tuning open-source LLMs and using a closed API for LLM Queries at Scale. 🤔
- Private GPT: Fine-Tune LLM on Enterprise Data - Exploring training techniques that allow fine-tuning LLMs on smaller GPUs. 🖥️
- Fine-Tuning Large Language Models (LLMs) - tuning pre-trained LLMs, discussing important concepts and providing a practical example with Python code.
- A Beginner's Guide to LLM Fine-Tuning - tuning LLMs, including the use of tools like QLoRA for configuring and fine-tuning models.
- Fine-tuning an LLM model with H2O LLM Studio to generate Cypher statements - tuning an LLM model using H2O LLM Studio for generating Cypher statements, enabling chatbot applications with knowledge graphs.
- Fine-Tune Your Own Llama 2 Model in a Colab Notebook - tuning, demonstrating how to implement it in a Google Colab notebook to create your own Llama 2 model.
- Thinking about fine-tuning a LLM? Here's 3 considerations before you get started - tuning LLMs, including ways to improve GPT beyond PEFT and LoRA, and the importance of investing resources wisely.
- When Should You Fine-Tune LLMs? - Exploring the comparison between fine-tuning open-source LLMs and using a closed API for LLM Queries at Scale. 🤔
- Private GPT: Fine-Tune LLM on Enterprise Data - Exploring training techniques that allow fine-tuning LLMs on smaller GPUs. 🖥️
- Fine-Tuning Large Language Models (LLMs) - tuning pre-trained LLMs, discussing important concepts and providing a practical example with Python code.
- A Beginner's Guide to LLM Fine-Tuning - tuning LLMs, including the use of tools like QLoRA for configuring and fine-tuning models.
- Fine-tuning an LLM model with H2O LLM Studio to generate Cypher statements - tuning an LLM model using H2O LLM Studio for generating Cypher statements, enabling chatbot applications with knowledge graphs.
- Fine-Tune Your Own Llama 2 Model in a Colab Notebook - tuning, demonstrating how to implement it in a Google Colab notebook to create your own Llama 2 model.
- Thinking about fine-tuning a LLM? Here's 3 considerations before you get started - tuning LLMs, including ways to improve GPT beyond PEFT and LoRA, and the importance of investing resources wisely.
- When Should You Fine-Tune LLMs? - Exploring the comparison between fine-tuning open-source LLMs and using a closed API for LLM Queries at Scale. 🤔
- Private GPT: Fine-Tune LLM on Enterprise Data - Exploring training techniques that allow fine-tuning LLMs on smaller GPUs. 🖥️
- Fine-Tuning Large Language Models (LLMs) - tuning pre-trained LLMs, discussing important concepts and providing a practical example with Python code.
- A Beginner's Guide to LLM Fine-Tuning - tuning LLMs, including the use of tools like QLoRA for configuring and fine-tuning models.
- Fine-tuning an LLM model with H2O LLM Studio to generate Cypher statements - tuning an LLM model using H2O LLM Studio for generating Cypher statements, enabling chatbot applications with knowledge graphs.
- Fine-Tune Your Own Llama 2 Model in a Colab Notebook - tuning, demonstrating how to implement it in a Google Colab notebook to create your own Llama 2 model.
- Private GPT: Fine-Tune LLM on Enterprise Data - Exploring training techniques that allow fine-tuning LLMs on smaller GPUs. 🖥️
- Thinking about fine-tuning a LLM? Here's 3 considerations before you get started - tuning LLMs, including ways to improve GPT beyond PEFT and LoRA, and the importance of investing resources wisely.
- When Should You Fine-Tune LLMs? - Exploring the comparison between fine-tuning open-source LLMs and using a closed API for LLM Queries at Scale. 🤔
- A Beginner's Guide to LLM Fine-Tuning - tuning LLMs, including the use of tools like QLoRA for configuring and fine-tuning models.
- Fine-Tuning Large Language Models (LLMs) - tuning pre-trained LLMs, discussing important concepts and providing a practical example with Python code.
- Fine-tuning an LLM model with H2O LLM Studio to generate Cypher statements - tuning an LLM model using H2O LLM Studio for generating Cypher statements, enabling chatbot applications with knowledge graphs.
- Fine-Tune Your Own Llama 2 Model in a Colab Notebook - tuning, demonstrating how to implement it in a Google Colab notebook to create your own Llama 2 model.
- Private GPT: Fine-Tune LLM on Enterprise Data - Exploring training techniques that allow fine-tuning LLMs on smaller GPUs. 🖥️
- Thinking about fine-tuning a LLM? Here's 3 considerations before you get started - tuning LLMs, including ways to improve GPT beyond PEFT and LoRA, and the importance of investing resources wisely.
- RAG vs Finetuning — Which Is the Best Tool to Boost Your LLM Application - A blog post discussing the aspects to consider when building LLM applications and choosing the right method for your use case. 👨‍💻
- When Should You Fine-Tune LLMs? - Exploring the comparison between fine-tuning open-source LLMs and using a closed API for LLM Queries at Scale. 🤔
- Fine-Tuning Large Language Models (LLMs) - tuning pre-trained LLMs, discussing important concepts and providing a practical example with Python code.
- A Beginner's Guide to LLM Fine-Tuning - tuning LLMs, including the use of tools like QLoRA for configuring and fine-tuning models.
- Fine-tuning an LLM model with H2O LLM Studio to generate Cypher statements - tuning an LLM model using H2O LLM Studio for generating Cypher statements, enabling chatbot applications with knowledge graphs.
- Fine-Tune Your Own Llama 2 Model in a Colab Notebook - tuning, demonstrating how to implement it in a Google Colab notebook to create your own Llama 2 model.
- Thinking about fine-tuning a LLM? Here's 3 considerations before you get started - tuning LLMs, including ways to improve GPT beyond PEFT and LoRA, and the importance of investing resources wisely.
- When Should You Fine-Tune LLMs? - Exploring the comparison between fine-tuning open-source LLMs and using a closed API for LLM Queries at Scale. 🤔
- Private GPT: Fine-Tune LLM on Enterprise Data - Exploring training techniques that allow fine-tuning LLMs on smaller GPUs. 🖥️
- Finetune Llama 3.1 with a production stack on AWS, GCP or Azure - A guide and tutorial on finetuning Llama 3.1 ([or Phi 3.5](https://www.zenml.io/blog/how-to-finetune-phi-3-5-with-zenml)) in a production setup designed for MLOps best practices. 📓
- Fine-Tuning Large Language Models (LLMs) - tuning pre-trained LLMs, discussing important concepts and providing a practical example with Python code.
- A Beginner's Guide to LLM Fine-Tuning - tuning LLMs, including the use of tools like QLoRA for configuring and fine-tuning models.
- Fine-tuning an LLM model with H2O LLM Studio to generate Cypher statements - tuning an LLM model using H2O LLM Studio for generating Cypher statements, enabling chatbot applications with knowledge graphs.
- Fine-Tune Your Own Llama 2 Model in a Colab Notebook - tuning, demonstrating how to implement it in a Google Colab notebook to create your own Llama 2 model.
- Thinking about fine-tuning a LLM? Here's 3 considerations before you get started - tuning LLMs, including ways to improve GPT beyond PEFT and LoRA, and the importance of investing resources wisely.
- RAG vs Finetuning — Which Is the Best Tool to Boost Your LLM Application - A blog post discussing the aspects to consider when building LLM applications and choosing the right method for your use case. 👨‍💻
- When Should You Fine-Tune LLMs? - Exploring the comparison between fine-tuning open-source LLMs and using a closed API for LLM Queries at Scale. 🤔
- Private GPT: Fine-Tune LLM on Enterprise Data - Exploring training techniques that allow fine-tuning LLMs on smaller GPUs. 🖥️
- Fine-Tuning Large Language Models (LLMs) - tuning pre-trained LLMs, discussing important concepts and providing a practical example with Python code.
- A Beginner's Guide to LLM Fine-Tuning - tuning LLMs, including the use of tools like QLoRA for configuring and fine-tuning models.
- Fine-tuning an LLM model with H2O LLM Studio to generate Cypher statements - tuning an LLM model using H2O LLM Studio for generating Cypher statements, enabling chatbot applications with knowledge graphs.
- Fine-Tune Your Own Llama 2 Model in a Colab Notebook - tuning, demonstrating how to implement it in a Google Colab notebook to create your own Llama 2 model.
- Thinking about fine-tuning a LLM? Here's 3 considerations before you get started - tuning LLMs, including ways to improve GPT beyond PEFT and LoRA, and the importance of investing resources wisely.
- RAG vs Finetuning — Which Is the Best Tool to Boost Your LLM Application - A blog post discussing the aspects to consider when building LLM applications and choosing the right method for your use case. 👨‍💻
- When Should You Fine-Tune LLMs? - Exploring the comparison between fine-tuning open-source LLMs and using a closed API for LLM Queries at Scale. 🤔
- Private GPT: Fine-Tune LLM on Enterprise Data - Exploring training techniques that allow fine-tuning LLMs on smaller GPUs. 🖥️
- Fine-Tuning Large Language Models (LLMs) - tuning pre-trained LLMs, discussing important concepts and providing a practical example with Python code.
- A Beginner's Guide to LLM Fine-Tuning - tuning LLMs, including the use of tools like QLoRA for configuring and fine-tuning models.
- Fine-tuning an LLM model with H2O LLM Studio to generate Cypher statements - tuning an LLM model using H2O LLM Studio for generating Cypher statements, enabling chatbot applications with knowledge graphs.
- Fine-Tune Your Own Llama 2 Model in a Colab Notebook - tuning, demonstrating how to implement it in a Google Colab notebook to create your own Llama 2 model.
- Thinking about fine-tuning a LLM? Here's 3 considerations before you get started - tuning LLMs, including ways to improve GPT beyond PEFT and LoRA, and the importance of investing resources wisely.
- When Should You Fine-Tune LLMs? - Exploring the comparison between fine-tuning open-source LLMs and using a closed API for LLM Queries at Scale. 🤔
- Private GPT: Fine-Tune LLM on Enterprise Data - Exploring training techniques that allow fine-tuning LLMs on smaller GPUs. 🖥️
- Fine-Tuning Large Language Models (LLMs) - tuning pre-trained LLMs, discussing important concepts and providing a practical example with Python code.
- A Beginner's Guide to LLM Fine-Tuning - tuning LLMs, including the use of tools like QLoRA for configuring and fine-tuning models.
- Fine-tuning an LLM model with H2O LLM Studio to generate Cypher statements - tuning an LLM model using H2O LLM Studio for generating Cypher statements, enabling chatbot applications with knowledge graphs.
- Fine-Tune Your Own Llama 2 Model in a Colab Notebook - tuning, demonstrating how to implement it in a Google Colab notebook to create your own Llama 2 model.
- Thinking about fine-tuning a LLM? Here's 3 considerations before you get started - tuning LLMs, including ways to improve GPT beyond PEFT and LoRA, and the importance of investing resources wisely.
- When Should You Fine-Tune LLMs? - Exploring the comparison between fine-tuning open-source LLMs and using a closed API for LLM Queries at Scale. 🤔
- Private GPT: Fine-Tune LLM on Enterprise Data - Exploring training techniques that allow fine-tuning LLMs on smaller GPUs. 🖥️
- Fine-Tuning Large Language Models (LLMs) - tuning pre-trained LLMs, discussing important concepts and providing a practical example with Python code.
- A Beginner's Guide to LLM Fine-Tuning - tuning LLMs, including the use of tools like QLoRA for configuring and fine-tuning models.
- Fine-tuning an LLM model with H2O LLM Studio to generate Cypher statements - tuning an LLM model using H2O LLM Studio for generating Cypher statements, enabling chatbot applications with knowledge graphs.
- Fine-Tune Your Own Llama 2 Model in a Colab Notebook - tuning, demonstrating how to implement it in a Google Colab notebook to create your own Llama 2 model.
- Thinking about fine-tuning a LLM? Here's 3 considerations before you get started - tuning LLMs, including ways to improve GPT beyond PEFT and LoRA, and the importance of investing resources wisely.
- When Should You Fine-Tune LLMs? - Exploring the comparison between fine-tuning open-source LLMs and using a closed API for LLM Queries at Scale. 🤔
- Private GPT: Fine-Tune LLM on Enterprise Data - Exploring training techniques that allow fine-tuning LLMs on smaller GPUs. 🖥️
- Fine-Tuning Large Language Models (LLMs) - tuning pre-trained LLMs, discussing important concepts and providing a practical example with Python code.
- A Beginner's Guide to LLM Fine-Tuning - tuning LLMs, including the use of tools like QLoRA for configuring and fine-tuning models.
- Fine-tuning an LLM model with H2O LLM Studio to generate Cypher statements - tuning an LLM model using H2O LLM Studio for generating Cypher statements, enabling chatbot applications with knowledge graphs.
- Fine-Tune Your Own Llama 2 Model in a Colab Notebook - tuning, demonstrating how to implement it in a Google Colab notebook to create your own Llama 2 model.
- Thinking about fine-tuning a LLM? Here's 3 considerations before you get started - tuning LLMs, including ways to improve GPT beyond PEFT and LoRA, and the importance of investing resources wisely.
- RAG vs Finetuning — Which Is the Best Tool to Boost Your LLM Application - A blog post discussing the aspects to consider when building LLM applications and choosing the right method for your use case. 👨‍💻
- When Should You Fine-Tune LLMs? - Exploring the comparison between fine-tuning open-source LLMs and using a closed API for LLM Queries at Scale. 🤔
- Private GPT: Fine-Tune LLM on Enterprise Data - Exploring training techniques that allow fine-tuning LLMs on smaller GPUs. 🖥️
- Fine-Tuning Large Language Models (LLMs) - tuning pre-trained LLMs, discussing important concepts and providing a practical example with Python code.
- A Beginner's Guide to LLM Fine-Tuning - tuning LLMs, including the use of tools like QLoRA for configuring and fine-tuning models.
- Fine-tuning an LLM model with H2O LLM Studio to generate Cypher statements - tuning an LLM model using H2O LLM Studio for generating Cypher statements, enabling chatbot applications with knowledge graphs.
- Fine-Tune Your Own Llama 2 Model in a Colab Notebook - tuning, demonstrating how to implement it in a Google Colab notebook to create your own Llama 2 model.
- Thinking about fine-tuning a LLM? Here's 3 considerations before you get started - tuning LLMs, including ways to improve GPT beyond PEFT and LoRA, and the importance of investing resources wisely.
- RAG vs Finetuning — Which Is the Best Tool to Boost Your LLM Application - A blog post discussing the aspects to consider when building LLM applications and choosing the right method for your use case. 👨‍💻
- When Should You Fine-Tune LLMs? - Exploring the comparison between fine-tuning open-source LLMs and using a closed API for LLM Queries at Scale. 🤔
- Private GPT: Fine-Tune LLM on Enterprise Data - Exploring training techniques that allow fine-tuning LLMs on smaller GPUs. 🖥️
- Thinking about fine-tuning a LLM? Here's 3 considerations before you get started - tuning LLMs, including ways to improve GPT beyond PEFT and LoRA, and the importance of investing resources wisely.
- A Beginner's Guide to LLM Fine-Tuning - tuning LLMs, including the use of tools like QLoRA for configuring and fine-tuning models.
- Fine-tuning an LLM model with H2O LLM Studio to generate Cypher statements - tuning an LLM model using H2O LLM Studio for generating Cypher statements, enabling chatbot applications with knowledge graphs.
- Fine-Tune Your Own Llama 2 Model in a Colab Notebook - tuning, demonstrating how to implement it in a Google Colab notebook to create your own Llama 2 model.
- RAG vs Finetuning — Which Is the Best Tool to Boost Your LLM Application - A blog post discussing the aspects to consider when building LLM applications and choosing the right method for your use case. 👨‍💻
- When Should You Fine-Tune LLMs? - Exploring the comparison between fine-tuning open-source LLMs and using a closed API for LLM Queries at Scale. 🤔
- Private GPT: Fine-Tune LLM on Enterprise Data - Exploring training techniques that allow fine-tuning LLMs on smaller GPUs. 🖥️
- Fine-Tuning Large Language Models (LLMs) - tuning pre-trained LLMs, discussing important concepts and providing a practical example with Python code.
- When Should You Fine-Tune LLMs? - Exploring the comparison between fine-tuning open-source LLMs and using a closed API for LLM Queries at Scale. 🤔
- Private GPT: Fine-Tune LLM on Enterprise Data - Exploring training techniques that allow fine-tuning LLMs on smaller GPUs. 🖥️
- Fine-Tuning Large Language Models (LLMs) - tuning pre-trained LLMs, discussing important concepts and providing a practical example with Python code.
- A Beginner's Guide to LLM Fine-Tuning - tuning LLMs, including the use of tools like QLoRA for configuring and fine-tuning models.
- Fine-tuning an LLM model with H2O LLM Studio to generate Cypher statements - tuning an LLM model using H2O LLM Studio for generating Cypher statements, enabling chatbot applications with knowledge graphs.
- Fine-Tune Your Own Llama 2 Model in a Colab Notebook - tuning, demonstrating how to implement it in a Google Colab notebook to create your own Llama 2 model.
- Thinking about fine-tuning a LLM? Here's 3 considerations before you get started - tuning LLMs, including ways to improve GPT beyond PEFT and LoRA, and the importance of investing resources wisely.
- RAG vs Finetuning — Which Is the Best Tool to Boost Your LLM Application - A blog post discussing the aspects to consider when building LLM applications and choosing the right method for your use case. 👨‍💻
- Fine-Tuning Large Language Models (LLMs) - tuning pre-trained LLMs, discussing important concepts and providing a practical example with Python code.
- A Beginner's Guide to LLM Fine-Tuning - tuning LLMs, including the use of tools like QLoRA for configuring and fine-tuning models.
- Fine-tuning an LLM model with H2O LLM Studio to generate Cypher statements - tuning an LLM model using H2O LLM Studio for generating Cypher statements, enabling chatbot applications with knowledge graphs.
- Fine-Tune Your Own Llama 2 Model in a Colab Notebook - tuning, demonstrating how to implement it in a Google Colab notebook to create your own Llama 2 model.
- Thinking about fine-tuning a LLM? Here's 3 considerations before you get started - tuning LLMs, including ways to improve GPT beyond PEFT and LoRA, and the importance of investing resources wisely.
- RAG vs Finetuning — Which Is the Best Tool to Boost Your LLM Application - A blog post discussing the aspects to consider when building LLM applications and choosing the right method for your use case. 👨‍💻
- When Should You Fine-Tune LLMs? - Exploring the comparison between fine-tuning open-source LLMs and using a closed API for LLM Queries at Scale. 🤔
- Private GPT: Fine-Tune LLM on Enterprise Data - Exploring training techniques that allow fine-tuning LLMs on smaller GPUs. 🖥️
- Fine-Tuning Large Language Models (LLMs) - tuning pre-trained LLMs, discussing important concepts and providing a practical example with Python code.
- A Beginner's Guide to LLM Fine-Tuning - tuning LLMs, including the use of tools like QLoRA for configuring and fine-tuning models.
- Fine-tuning an LLM model with H2O LLM Studio to generate Cypher statements - tuning an LLM model using H2O LLM Studio for generating Cypher statements, enabling chatbot applications with knowledge graphs.
- Fine-Tune Your Own Llama 2 Model in a Colab Notebook - tuning, demonstrating how to implement it in a Google Colab notebook to create your own Llama 2 model.
- Thinking about fine-tuning a LLM? Here's 3 considerations before you get started - tuning LLMs, including ways to improve GPT beyond PEFT and LoRA, and the importance of investing resources wisely.
- RAG vs Finetuning — Which Is the Best Tool to Boost Your LLM Application - A blog post discussing the aspects to consider when building LLM applications and choosing the right method for your use case. 👨‍💻
- When Should You Fine-Tune LLMs? - Exploring the comparison between fine-tuning open-source LLMs and using a closed API for LLM Queries at Scale. 🤔
- Private GPT: Fine-Tune LLM on Enterprise Data - Exploring training techniques that allow fine-tuning LLMs on smaller GPUs. 🖥️
- Fine-Tuning Large Language Models (LLMs) - tuning pre-trained LLMs, discussing important concepts and providing a practical example with Python code.
- A Beginner's Guide to LLM Fine-Tuning - tuning LLMs, including the use of tools like QLoRA for configuring and fine-tuning models.
- Fine-tuning an LLM model with H2O LLM Studio to generate Cypher statements - tuning an LLM model using H2O LLM Studio for generating Cypher statements, enabling chatbot applications with knowledge graphs.
- Fine-Tune Your Own Llama 2 Model in a Colab Notebook - tuning, demonstrating how to implement it in a Google Colab notebook to create your own Llama 2 model.
- Thinking about fine-tuning a LLM? Here's 3 considerations before you get started - tuning LLMs, including ways to improve GPT beyond PEFT and LoRA, and the importance of investing resources wisely.
- When Should You Fine-Tune LLMs? - Exploring the comparison between fine-tuning open-source LLMs and using a closed API for LLM Queries at Scale. 🤔
- Private GPT: Fine-Tune LLM on Enterprise Data - Exploring training techniques that allow fine-tuning LLMs on smaller GPUs. 🖥️
- RAG vs Finetuning — Which Is the Best Tool to Boost Your LLM Application - A blog post discussing the aspects to consider when building LLM applications and choosing the right method for your use case. 👨‍💻
- When Should You Fine-Tune LLMs? - Exploring the comparison between fine-tuning open-source LLMs and using a closed API for LLM Queries at Scale. 🤔
- Private GPT: Fine-Tune LLM on Enterprise Data - Exploring training techniques that allow fine-tuning LLMs on smaller GPUs. 🖥️
- Fine-Tuning Large Language Models (LLMs) - tuning pre-trained LLMs, discussing important concepts and providing a practical example with Python code.
- Fine-tuning an LLM model with H2O LLM Studio to generate Cypher statements - tuning an LLM model using H2O LLM Studio for generating Cypher statements, enabling chatbot applications with knowledge graphs.
- Fine-Tune Your Own Llama 2 Model in a Colab Notebook - tuning, demonstrating how to implement it in a Google Colab notebook to create your own Llama 2 model.
- Thinking about fine-tuning a LLM? Here's 3 considerations before you get started - tuning LLMs, including ways to improve GPT beyond PEFT and LoRA, and the importance of investing resources wisely.
- A Beginner's Guide to LLM Fine-Tuning - tuning LLMs, including the use of tools like QLoRA for configuring and fine-tuning models.
- Fine-Tuning Large Language Models (LLMs) - tuning pre-trained LLMs, discussing important concepts and providing a practical example with Python code.
- A Beginner's Guide to LLM Fine-Tuning - tuning LLMs, including the use of tools like QLoRA for configuring and fine-tuning models.
- Fine-tuning an LLM model with H2O LLM Studio to generate Cypher statements - tuning an LLM model using H2O LLM Studio for generating Cypher statements, enabling chatbot applications with knowledge graphs.
- Fine-Tune Your Own Llama 2 Model in a Colab Notebook - tuning, demonstrating how to implement it in a Google Colab notebook to create your own Llama 2 model.
- Thinking about fine-tuning a LLM? Here's 3 considerations before you get started - tuning LLMs, including ways to improve GPT beyond PEFT and LoRA, and the importance of investing resources wisely.
- RAG vs Finetuning — Which Is the Best Tool to Boost Your LLM Application - A blog post discussing the aspects to consider when building LLM applications and choosing the right method for your use case. 👨‍💻
- When Should You Fine-Tune LLMs? - Exploring the comparison between fine-tuning open-source LLMs and using a closed API for LLM Queries at Scale. 🤔
- Private GPT: Fine-Tune LLM on Enterprise Data - Exploring training techniques that allow fine-tuning LLMs on smaller GPUs. 🖥️
- Fine-Tuning Large Language Models (LLMs) - tuning pre-trained LLMs, discussing important concepts and providing a practical example with Python code.
- A Beginner's Guide to LLM Fine-Tuning - tuning LLMs, including the use of tools like QLoRA for configuring and fine-tuning models.
- Fine-tuning an LLM model with H2O LLM Studio to generate Cypher statements - tuning an LLM model using H2O LLM Studio for generating Cypher statements, enabling chatbot applications with knowledge graphs.
- Fine-Tune Your Own Llama 2 Model in a Colab Notebook - tuning, demonstrating how to implement it in a Google Colab notebook to create your own Llama 2 model.
- Thinking about fine-tuning a LLM? Here's 3 considerations before you get started - tuning LLMs, including ways to improve GPT beyond PEFT and LoRA, and the importance of investing resources wisely.
- RAG vs Finetuning — Which Is the Best Tool to Boost Your LLM Application - A blog post discussing the aspects to consider when building LLM applications and choosing the right method for your use case. 👨‍💻
- When Should You Fine-Tune LLMs? - Exploring the comparison between fine-tuning open-source LLMs and using a closed API for LLM Queries at Scale. 🤔
- Private GPT: Fine-Tune LLM on Enterprise Data - Exploring training techniques that allow fine-tuning LLMs on smaller GPUs. 🖥️
- Fine-Tune LLMs in 2024 with Hugging Face: TRL and Flash Attention - tune LLMs (e.g., Llama 2), using hugging face trl and flash attention on consumer size GPUs (24GB).
- Complete Guide to LLM Fine Tuning for Beginners - tuning a pre-trained model for new tasks, covering key concepts and providing a concrete example.
- Fine-Tuning Large Language Models (LLMs) - tuning pre-trained LLMs, discussing important concepts and providing a practical example with Python code.
- Creating a Domain Expert LLM: A Guide to Fine-Tuning - tuning using OpenAI's API, showcasing an example of fine-tuning a large language model for understanding the plot of a Handel opera.
- A Beginner's Guide to LLM Fine-Tuning - tuning LLMs, including the use of tools like QLoRA for configuring and fine-tuning models.
- Fine-tuning an LLM model with H2O LLM Studio to generate Cypher statements - tuning an LLM model using H2O LLM Studio for generating Cypher statements, enabling chatbot applications with knowledge graphs.
- Fine-Tune Your Own Llama 2 Model in a Colab Notebook - tuning, demonstrating how to implement it in a Google Colab notebook to create your own Llama 2 model.
- Thinking about fine-tuning a LLM? Here's 3 considerations before you get started - tuning LLMs, including ways to improve GPT beyond PEFT and LoRA, and the importance of investing resources wisely.
- Introduction to LLMs and the generative AI : Part 3—Fine Tuning LLM with instruction - tuning them.
- RAG vs Finetuning — Which Is the Best Tool to Boost Your LLM Application - A blog post discussing the aspects to consider when building LLM applications and choosing the right method for your use case. 👨‍💻
- Finetuning an LLM: RLHF and alternatives (Part I) - An article showcasing alternative methods to RLHF, specifically Direct Preference Optimization (DPO). 🔄
- When Should You Fine-Tune LLMs? - Exploring the comparison between fine-tuning open-source LLMs and using a closed API for LLM Queries at Scale. 🤔
- Fine-Tuning Large Language Models - Considering the fine-tuning of large language models and comparing it to zero and few shot approaches. 🎯
- Private GPT: Fine-Tune LLM on Enterprise Data - Exploring training techniques that allow fine-tuning LLMs on smaller GPUs. 🖥️
- Fine-tune Google PaLM 2 with Scikit-LLM - Demonstrating how to fine-tune Google PaLM 2, the most advanced LLM from Google, using Scikit-LLM. 📈
- A Deep-Dive into Fine-Tuning of Large Language Models - A comprehensive blog on fine-tuning LLMs like GPT-4 & BERT, providing insights, trends, and benefits. 🚀
- Pre-training, fine-tuning and in-context learning in Large Language Models - Discussing the concepts of pre-training, fine-tuning, and in-context learning in LLMs. 📚
- List of Open Sourced Fine-Tuned Large Language Models - A curated list of open-sourced fine-tuned LLMs that can be run locally on your computer. 📋
- Practitioners guide to fine-tune LLMs for domain-specific use case - A guide covering key learnings and conclusions on fine-tuning LLMs for domain-specific use cases. 📝
- Knowledge Graphs & LLMs: Fine-Tuning Vs. Retrieval-Augmented Generation - tuning them in conjunction with knowledge graphs.
- Fine-tune an LLM on your personal data: create a “The Lord of the Rings” storyteller - 4.
- Fine-Tuning Large Language Models (LLMs) - tuning pre-trained LLMs, discussing important concepts and providing a practical example with Python code.
- A Beginner's Guide to LLM Fine-Tuning - tuning LLMs, including the use of tools like QLoRA for configuring and fine-tuning models.
- Fine-tuning an LLM model with H2O LLM Studio to generate Cypher statements - tuning an LLM model using H2O LLM Studio for generating Cypher statements, enabling chatbot applications with knowledge graphs.
- Fine-Tune Your Own Llama 2 Model in a Colab Notebook - tuning, demonstrating how to implement it in a Google Colab notebook to create your own Llama 2 model.
- Thinking about fine-tuning a LLM? Here's 3 considerations before you get started - tuning LLMs, including ways to improve GPT beyond PEFT and LoRA, and the importance of investing resources wisely.
- When Should You Fine-Tune LLMs? - Exploring the comparison between fine-tuning open-source LLMs and using a closed API for LLM Queries at Scale. 🤔
- Private GPT: Fine-Tune LLM on Enterprise Data - Exploring training techniques that allow fine-tuning LLMs on smaller GPUs. 🖥️
- Fine-Tuning Large Language Models (LLMs) - tuning pre-trained LLMs, discussing important concepts and providing a practical example with Python code.
- A Beginner's Guide to LLM Fine-Tuning - tuning LLMs, including the use of tools like QLoRA for configuring and fine-tuning models.
- Fine-tuning an LLM model with H2O LLM Studio to generate Cypher statements - tuning an LLM model using H2O LLM Studio for generating Cypher statements, enabling chatbot applications with knowledge graphs.
- Fine-Tune Your Own Llama 2 Model in a Colab Notebook - tuning, demonstrating how to implement it in a Google Colab notebook to create your own Llama 2 model.
- Thinking about fine-tuning a LLM? Here's 3 considerations before you get started - tuning LLMs, including ways to improve GPT beyond PEFT and LoRA, and the importance of investing resources wisely.
- When Should You Fine-Tune LLMs? - Exploring the comparison between fine-tuning open-source LLMs and using a closed API for LLM Queries at Scale. 🤔
- Private GPT: Fine-Tune LLM on Enterprise Data - Exploring training techniques that allow fine-tuning LLMs on smaller GPUs. 🖥️
- Fine-Tuning Large Language Models (LLMs) - tuning pre-trained LLMs, discussing important concepts and providing a practical example with Python code.
- A Beginner's Guide to LLM Fine-Tuning - tuning LLMs, including the use of tools like QLoRA for configuring and fine-tuning models.
- Fine-tuning an LLM model with H2O LLM Studio to generate Cypher statements - tuning an LLM model using H2O LLM Studio for generating Cypher statements, enabling chatbot applications with knowledge graphs.
- Fine-Tune Your Own Llama 2 Model in a Colab Notebook - tuning, demonstrating how to implement it in a Google Colab notebook to create your own Llama 2 model.
- Thinking about fine-tuning a LLM? Here's 3 considerations before you get started - tuning LLMs, including ways to improve GPT beyond PEFT and LoRA, and the importance of investing resources wisely.
- When Should You Fine-Tune LLMs? - Exploring the comparison between fine-tuning open-source LLMs and using a closed API for LLM Queries at Scale. 🤔
- Private GPT: Fine-Tune LLM on Enterprise Data - Exploring training techniques that allow fine-tuning LLMs on smaller GPUs. 🖥️
- Fine-Tuning Large Language Models (LLMs) - tuning pre-trained LLMs, discussing important concepts and providing a practical example with Python code.
- A Beginner's Guide to LLM Fine-Tuning - tuning LLMs, including the use of tools like QLoRA for configuring and fine-tuning models.
- Fine-tuning an LLM model with H2O LLM Studio to generate Cypher statements - tuning an LLM model using H2O LLM Studio for generating Cypher statements, enabling chatbot applications with knowledge graphs.
- When Should You Fine-Tune LLMs? - Exploring the comparison between fine-tuning open-source LLMs and using a closed API for LLM Queries at Scale. 🤔
- Private GPT: Fine-Tune LLM on Enterprise Data - Exploring training techniques that allow fine-tuning LLMs on smaller GPUs. 🖥️
- Fine-Tune Your Own Llama 2 Model in a Colab Notebook - tuning, demonstrating how to implement it in a Google Colab notebook to create your own Llama 2 model.
- Thinking about fine-tuning a LLM? Here's 3 considerations before you get started - tuning LLMs, including ways to improve GPT beyond PEFT and LoRA, and the importance of investing resources wisely.
- RAG vs Finetuning — Which Is the Best Tool to Boost Your LLM Application - A blog post discussing the aspects to consider when building LLM applications and choosing the right method for your use case. 👨‍💻
GitHub projects
- AutoTrain - No code fine-tuning of LLMs and other machine learning tasks.
- lit-gpt - of-the-art open-source LLMs based on nanoGPT. Supports flash attention, 4-bit and 8-bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed. (3469 stars)
- LlamaIndex
- Petals - style. Fine-tuning and inference up to 10x faster than offloading. (7768 stars)
- LLaMA-Factory - to-use LLM fine-tuning framework (LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, ChatGLM3). (5532 stars)
- H2O LLM Studio - code GUI for fine-tuning LLMs. Documentation: [https://h2oai.github.io/h2o-llmstudio/](https://h2oai.github.io/h2o-llmstudio/) (2880 stars)
- Phoenix - Evaluate, troubleshoot, and fine tune your LLM, CV, and NLP models in a notebook. (1596 stars)
- LLM-Adapters - Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models". (769 stars)
- Platypus - tuning Platypus fam LLMs using LoRA. (589 stars)
- xtuner - tuning LLM (InternLM, Llama, Baichuan, QWen, ChatGLM2). (540 stars)
- Finetune_LLMs - tuning Casual LLMs. :star: 391
- MFTCoder - task fine-tuning framework for Code LLMs; 业内首个高精度、高效率、多任务、多模型支持、多训练算法，大模型代码能力微调框架. :star: 337
- llmware - grade LLM-based development framework, tools, and fine-tuned models. :star: 289
- LLM-Kit
- h2o-wizardlm - Source Implementation of WizardLM to turn documents into Q:A pairs for LLM fine-tuning. :star: 228
- hcgf - model Fine-tuning | LLM微调. :star: 196
- llm_qlora - tuning LLMs using QLoRA. :star: 136
- awesome-llm-human-preference-datasets - tuning, RLHF, and eval. :star: 124
- llm_finetuning - tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes). :star: 114
- DB-GPT-Hub - tuning techniques for DB-GPT, with the purpose of enhancing model performance, especially in Text-to-SQL, and achieved higher exec acc than GPT-4 in spider eval with 13B LLM used this project. (422 stars)
Videos
- Intro to Large Language Models by Andrej Karpathy - day operating systems, and some of the security-related challenges of this new computing paradigm.
- AI News: Creating LLMs without code! - YouTube - Maya Akim discusses the top 5 LLM fine-tuning use cases you need to know.
- Top 5 LLM Fine-Tuning Use Cases You Need to Know - YouTube - An in-depth video highlighting the top 5 LLM fine-tuning use cases with additional links for further exploration.
- clip2 llm emory - YouTube - Learn how to fine-tune Llama 2 on your own dataset and train an LLM for your specific use case.
- The EASIEST way to finetune LLAMA-v2 on a local machine! - YouTube - A step-by-step video guide demonstrating the easiest, simplest, and fastest way to fine-tune LLAMA-v2 on your local machine for a custom dataset.
- Training & Fine-Tuning LLMs: Introduction - YouTube - An introduction to training and fine-tuning LLMs, including important concepts and the NeurIPS LLM Efficiency Challenge.
- Fine-tuning LLMs with PEFT and LoRA - YouTube - A comprehensive video exploring how to use PEFT to fine-tune any decoder-style GPT model, including the basics of LoRA fine-tuning and uploading.
- Building and Curating Datasets for RLHF and LLM Fine-tuning ... - Learn about building and curating datasets for RLHF (Reinforcement Learning from Human Feedback) and LLM (Large Language Model) fine-tuning, with sponsorship by Argilla.
- Fine Tuning LLM (OpenAI GPT) with Custom Data in Python - YouTube - Explore how to extend LLM (OpenAI GPT) by fine-tuning it with a custom dataset to provide Q&A, summary, and other ChatGPT-like functions.
- Intro to Large Language Models by Andrej Karpathy - day operating systems, and some of the security-related challenges of this new computing paradigm.
- Fine-tuning Llama 2 on Your Own Dataset | Train an LLM for Your ... - tune Llama 2 model on a custom dataset.
- Fine-tuning LLM with QLoRA on Single GPU: Training Falcon-7b on ... - tuning process of the Falcon 7b LLM using QLoRA.
- Fine-tuning an LLM using PEFT | Introduction to Large Language ... - tune an LLM using PEFT, a technique that requires fewer resources.
- LLAMA-2 Open-Source LLM: Custom Fine-tuning Made Easy on a ... - by-step guide on how to fine-tune the LLama 2 LLM model on your custom dataset.
- New Course: Finetuning Large Language Models - YouTube - tuning LLMs, covering model selection, data preparation, training, and evaluation.
- Q: How to create an Instruction Dataset for Fine-tuning my LLM ... - tuning LLMs, including when, how, and why to do it.
- LLM Module 4: Fine-tuning and Evaluating LLMs | 4.13.1 Notebook ... - tuning and evaluating LLMs.
- Google LLM Fine-Tuning/Adapting/Customizing - Getting Started ... - tuning Google's PaLM 2 large language model through a step-by-step guide.
- Pretraining vs Fine-tuning vs In-context Learning of LLM (GPT-x ... - tuning, and in-context learning of LLMs like GPT-x.
- How to Fine-Tune an LLM with a PDF - Langchain Tutorial - YouTube - tune OpenAI's GPT LLM to process PDF documents using Langchain and PDF libraries.
- EasyTune Walkthrough - YouTube - A walkthrough of fine-tuning LLM with QLoRA on a single GPU using Falcon-7b.
- Unlocking the Potential of ChatGPT Lessons in Training and Fine ... - THE STUDENT presents the instruction fine-tuning and in-context learning of LLMs with symbols.
Online Courses
- Fine-Tuning Fundamentals: Unlocking the Potential of LLMs | Udemy - style models and adapting them for specific use cases.
- Generative AI with Large Language Models | Coursera
- Finetuning Large Language Models | Coursera Guided Project
- OpenAI & ChatGPT API's: Expert Fine-tuning for Developers | Udemy - 3 in creating conversational AI solutions, including topics like prompt engineering, fine-tuning, integration, and deploying ChatGPT models.
- Large Language Models Professional Certificate | edX
- Improving the Performance of Your LLM Beyond Fine Tuning | Udemy - tuning LLM models and exploring techniques for improving their performance.
- Introduction to Large Language Models | Coursera - learning course offered by Google Cloud, explaining the basics of Large Language Models (LLMs) and their use cases. Enroll for free.
- Syllabus | LLM101x | edX - tune LLMs with domain-specific data to augment LLM pipelines.
- Performance Tuning Deep Learning Models Master Class | Udemy
- Best Large Language Models (LLMs) Courses & Certifications - tuning LLMs.
- Mastering Language Models: Unleashing the Power of LLMs
- LLMs Mastery: Complete Guide to Transformers & Generative AI - tuning the three major LLM models: BERT, GPT, and T5. Suitable for those interested in generative AI, LLMs, and production-level applications.
- Exploring The Technologies Behind ChatGPT, GPT4 & LLMs
- Non-technical Introduction to Large Language Models - technical individuals, explaining the existing challenges and providing simple explanations without complex jargon.
Books
- Principles for Fine-tuning LLMs
- From Data Selection To Fine Tuning: The Technical Guide To Constructing LLM Models
- Hands-On Large Language Models
- Fine-tune Llama 2 for text generation on Amazon SageMaker JumpStart
- Fast and cost-effective LLaMA 2 fine-tuning with AWS Trainium
- Fine-tuning - Advanced Deep Learning with Python [Book - tuning task following the pretraining task in advanced deep learning with Python.
- The LLM Knowledge Cookbook: From, RAG, to QLoRA, to Fine ... - tuning techniques.
- Quick Start Guide to Large Language Models: Strategies and Best ...
- 4. Advanced GPT-4 and ChatGPT Techniques - Developing Apps ... - 4 and ChatGPT, including prompt engineering, zero-shot learning, few-shot learning, and task-specific fine-tuning.
- What are Large Language Models? - LLM AI Explained - AWS - shot learning and fine-tuning to improve model performance.
- Generative AI with Large Language Models — New Hands-on Course by Deeplearning.ai and AWS
- From Data Selection To Fine Tuning: The Technical Guide To Constructing LLM Models
- The LLM Knowledge Cookbook: From, RAG, to QLoRA, to Fine Tuning, and all the Recipes In Between!
Research Papers
- LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning - Adapters, an easy-to-use framework that integrates various adapters into LLMs for parameter-efficient fine-tuning (PEFT) on different tasks.
- Two-stage LLM Fine-tuning with Less Specialization - stage fine-tuning framework, addresses the issue of format specialization in LLMs through Prompt Tuning with MOdel Tuning, improving their general in-context learning performance.
- Fine-tuning Large Enterprise Language Models via Ontological Reasoning - specific fine-tuning of LLMs.
- QLoRA: Efficient Finetuning of Quantized LLMs
- Full Parameter Fine-tuning for Large Language Models with Limited Resources - memory optimization technique, enabling the full parameter fine-tuning of large LLMs with limited GPU resources.
- LoRA: Low-Rank Adaptation of Large Language Models - trained models to specific tasks by injecting trainable rank decomposition matrices into each layer, reducing the number of trainable parameters while maintaining model quality.
- Enhancing LLM with Evolutionary Fine Tuning for News Summary Generation
- How do languages influence each other? Studying cross-lingual data sharing during LLM fine-tuning - lingual data sharing during fine-tuning of multilingual large language models (MLLMs) and analyzes the influence of different languages on model performance.
- Fine-Tuning Language Models with Just Forward Passes - efficient zeroth-order optimizer, enables fine-tuning of large language models while significantly reducing the memory requirements.
- Learning to Reason over Scene Graphs: A Case Study of Finetuning LLMs - 2 LLMs in robotic task planning, demonstrating the potential for using LLMs in long-horizon task planning scenarios.
- Privately Fine-Tuning Large Language Models with - tuning large language models (LLMs).
- DISC-LawLLM: Fine-tuning Large Language Models for Intelligent Legal Systems - LawLLM, an intelligent legal system that utilizes fine-tuned LLMs with legal reasoning capability to provide a wide range of legal services.
- Multi-Task Instruction Tuning of LLaMa for Specific Scenarios: A - tuning LLaMa, a foundational LLM, on specific writing tasks, demonstrating significant improvement in writing abilities.
- Training language models to follow instructions with human feedback - tuning them using human feedback, resulting in models preferred over larger models in human evaluations.
- Large Language Models Can Self-Improve - improve their reasoning abilities by fine-tuning using self-generated solutions, achieving state-of-the-art performance without ground truth labels.
- Embracing Large Language Models for Medical Applications - tuned LLMs in medical applications, improving diagnostic accuracy and supporting clinical decision-making.
- Scaling Instruction-Finetuned Language Models - tuning on LLMs, demonstrating significant improvements in performance and generalization to unseen tasks.
- Federated Fine-tuning of Billion-Sized Language Models across - tuning large LLMs on mobile devices, improving memory and time efficiency.
- A Comprehensive Overview of Large Language Models
- Fine-tuning language models to find agreement among humans with - tuning of a large LLM to generate consensus statements that maximize approval for a group of people with diverse opinions.
Tools & Software
- LLaMA Efficient Tuning - to-use LLM fine-tuning framework (LLaMA-2, BLOOM, Falcon).
- H2O LLM Studio - code GUI for fine-tuning LLMs.
- PEFT - Efficient Fine-Tuning (PEFT) methods for efficient adaptation of pre-trained language models to downstream applications.
- ChatGPT-like model - like model locally on your device.
- Petals - 176B collaboratively, allowing you to load a small part of the model and team up with others for inference or fine-tuning. 🌸
- NVIDIA NeMo - of-the-art conversational AI models and specifically designed for Linux. 🚀
- H2O LLM Studio - code GUI tool for fine-tuning large language models on Windows. 🎛️
- Ludwig AI - code framework for building custom LLMs and other deep neural networks. Easily train state-of-the-art LLMs with a declarative YAML configuration file. 🤖
- bert4torch - source large model weights for reasoning and fine-tuning. 🔥
- Alpaca.cpp - like model locally on your device. A combination of the LLaMA foundation model and an open reproduction of Stanford Alpaca for instruction-tuned fine-tuning. 🦙
- promptfoo
Conferences & Events
- ML/AI Conversation: Neuro-Symbolic AI - an Alternative to LLM - This meetup will discuss the experience with fine-tuning LLMs and explore neuro-symbolic AI as an alternative.
- AI Dev Day - Seattle, Mon, Oct 30, 2023, 5:00 PM - A tech talk on effective LLM observability and fine-tuning opportunities using vector similarity search.
- DeepLearning.AI Events - A series of events including mitigating LLM hallucinations, fine-tuning LLMs with PyTorch 2.0 and ChatGPT, and AI education programs.
- AI Dev Day - New York, Thu, Oct 26, 2023, 5:30 PM - Tech talks on best practices in GenAI applications and using LLMs for real-time, personalized notifications.
- Chat LLMs & AI Agents - Use Gen AI to Build AI Systems and Agents - An event focusing on LLMs, AI agents, and chain data, with opportunities for interaction through event chat.
- NYC AI/LLM/ChatGPT Developers Group - Regular tech talks/workshops for developers interested in AI, LLMs, ChatGPT, NLP, ML, Data, etc.
- Leveraging LLMs for Enterprise Data, Tue, Nov 14, 2023, 2:00 PM - Dive into essential LLM strategies tailored for non-public data applications, including prompt engineering and retrieval.
- Bellevue Applied Machine Learning Meetup - A meetup focusing on applied machine learning techniques and improving the skills of data scientists and ML practitioners.
- AI & Prompt Engineering Meetup Munich, Do., 5. Okt. 2023, 18:15 - Introduce H2O LLM Studio for fine-tuning LLMs and bring together AI enthusiasts from various backgrounds.
- Seattle AI/ML/Data Developers Group - Tech talks on evaluating LLM agents and learning AI/ML/Data through practice.
- Data Science Dojo - DC | Meetup - based meetup group for business professionals interested in teaching, learning, and sharing knowledge and understanding of data science.
- Find Data Science Events & Groups in Dubai, AE
- AI Meetup (in-person): Generative AI and LLMs - Halloween Edition - source tools and best practices.
- ChatGPT Unleashed: Live Demo and Best Practices for NLP - tuning hacks for Large Language Models and showcases the practical applications of ChatGPT and LLMs.
- Find Data Science Events & Groups in Pune, IN - person events and groups related to data science in Pune, IN.
- DC AI/ML/Data Developers Group | Meetup
- Boston AI/LLMs/ChatGPT Developers Group | Meetup
- Paris NLP | Meetup
- SF AI/LLMs/ChatGPT Developers Group | Meetup
- AI meetup (In-person): GenAI and LLMs for Health - related tasks.
Slides & Presentations
- Fine tune and deploy Hugging Face NLP models | PPT - A presentation that provides insights on how to build and deploy LLM models using Hugging Face NLP.
- Fine tuning large LMs - tuning large language models like GPT, BERT, and RoBERTa.
- LLaMa 2.pptx
- LLM.pdf - 3.
- Large Language Models Bootcamp - tuning.
- The LHC Explained by CNN - tuning image models.
- Using Large Language Models in 10 Lines of Code
- LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attention.pdf - A PDF discussing the efficient fine-tuning of Language Models with zero-init attention using LLaMA.
- Intro to LLMs - tuning with prompt-completion pairs.
- LLM Fine-Tuning (東大松尾研LLM講座 Day5資料) - Speaker Deck - tuning large language models, specifically for the 東大松尾研サマースクール2023.
- Automate your Job and Business with ChatGPT #3
- Unlocking the Power of Generative AI An Executive's Guide.pdf - A guide that explains the process of fine-tuning Large Language Models (LLMs) to tailor them to an organization's needs.
- 大規模言語モデル時代のHuman-in-the-Loop機械学習 - Speaker Deck - A slide deck discussing the process of fine-tuning Language Models to find agreement among humans with diverse preferences.
- AI and ML Series - Introduction to Generative AI and LLMs | PPT - A presentation introducing Generative AI and LLMs, including their usage in specific applications.
- Retrieval Augmented Generation in Practice: Scalable GenAI ... - A presentation discussing use cases for Generative AI, limitations of Large Language Models, and the use of Retrieval Augmented Generation (RAG) and fine-tuning techniques.
- LLM presentation final | PPT - A presentation covering the Child & Family Agency Act 2013 and the Best Interest Principle in the context of LLMs.
- LLM Paradigm Adaptations in Recommender Systems.pdf - A PDF explaining the fine-tuning process and objective adaptations in LLM-based recommender systems.
- Conversational AI with Transformer Models | PPT - A presentation highlighting the use of Transformer Models in Conversational AI applications.
- Llama-index | PPT - A presentation on the rise of LLMs and building LLM-powered applications.
Podcasts
- Weaviate Podcast - Join Connor Shorten for the Weaviate Podcast series, featuring interviews with experts and discussions on AI-related topics.
- Latent Space: The AI Engineer Podcast — CodeGen, Agents, Computer Vision, Data Science, AI UX and all things Software 3.0 - Dive into the world of AI engineering, covering topics like code generation, computer vision, data science, and the latest advancements in AI UX.
- Unsupervised Learning - Gain insights into the rapidly developing AI landscape and its impact on businesses and the world. Explore discussions on LLM applications, trends, and disrupting technologies.
- The TWIML AI Podcast (formerly This Week in Machine Learning) - Dive deep into fine-tuning approaches used in AI, LLM capabilities and limitations, and learn from experts in the field.
- AI and the Future of Work on Apple Podcasts
- Practical AI: Machine Learning, Data Science: Fine-tuning vs RAG - tuning and retrieval augmented generation in machine learning and data science.
- Unsupervised Learning on Apple Podcasts
- Papers Read on AI | Podcast on Spotify
- This Day in AI Podcast on Apple Podcasts - related topics, this podcast offers exciting insights into the world of AI.
- All About Evaluating LLM Applications // Shahul Es // #179 MLOps
- AI Daily on Apple Podcasts - related stories.
- Yannic Kilcher Videos (Audio Only) | Podcast on Spotify
- LessWrong Curated Podcast | Podcast on Spotify
- SAI: The Security and AI Podcast on Apple Podcasts
- Practical AI: Machine Learning, Data Science - Making artificial intelligence practical, productive, and accessible to everyone. Engage in lively discussions about AI, machine learning, deep learning, neural networks, and more. Accessible insights and real-world scenarios for both beginners and seasoned practitioners.
- Gradient Dissent: Exploring Machine Learning, AI, Deep Learning - Go behind the scenes to learn from industry leaders about how they are implementing deep learning in real-world scenarios. Gain insights into the machine learning industry and stay updated with the latest trends.

Programming Languages

Python 16 Jupyter Notebook 2

Ecosyste.ms: Awesome

awesome-llms-fine-tuning

Articles & Blogs

GitHub projects

Videos

Online Courses

Books

Research Papers

Tools & Software

Conferences & Events

Slides & Presentations

Podcasts