Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/ashishpatel26/LLM-Finetuning
LLM Finetuning with peft
https://github.com/ashishpatel26/LLM-Finetuning
falcon fine-tuning huggingface llama llama2 llm llms lora peft pytorch text-generation
Last synced: about 1 month ago
JSON representation
LLM Finetuning with peft
- Host: GitHub
- URL: https://github.com/ashishpatel26/LLM-Finetuning
- Owner: ashishpatel26
- Created: 2023-06-08T05:11:00.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2024-07-08T06:47:16.000Z (2 months ago)
- Last Synced: 2024-07-31T01:33:40.108Z (about 1 month ago)
- Topics: falcon, fine-tuning, huggingface, llama, llama2, llm, llms, lora, peft, pytorch, text-generation
- Language: Jupyter Notebook
- Homepage:
- Size: 3.44 MB
- Stars: 1,934
- Watchers: 29
- Forks: 537
- Open Issues: 4
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
- awesome-generative-ai-guide - LLM Fine-tuning tutorials
- AiTreasureBox - ashishpatel26/LLM-Finetuning - 09-08_2029_0](https://img.shields.io/github/stars/ashishpatel26/LLM-Finetuning.svg)|LLM Finetuning with peft| (Repos)
README
# LLM-Finetuning
# PEFT Fine-Tuning Project 🚀
Welcome to the PEFT (Pretraining-Evaluation Fine-Tuning) project repository! This project focuses on efficiently fine-tuning large language models using LoRA and Hugging Face's transformers library.
## Fine Tuning Notebook Table 📑
| Notebook Title | Description | Colab Badge |
| ------------------------------------------------------------ | ------------------------------------------------------------ | ------------------------------------------------------------ |
| **1. Efficiently Train Large Language Models with LoRA and Hugging Face** | Details and code for efficient training of large language models using LoRA and Hugging Face. | [](https://colab.research.google.com/github/ashishpatel26/LLM-Finetuning/blob/main/1.Efficiently_train_Large_Language_Models_with_LoRA_and_Hugging_Face.ipynb) |
| **2. Fine-Tune Your Own Llama 2 Model in a Colab Notebook** | Guide to fine-tuning your Llama 2 model using Colab. | [](https://colab.research.google.com/github/ashishpatel26/LLM-Finetuning/blob/main/2.Fine_Tune_Your_Own_Llama_2_Model_in_a_Colab_Notebook.ipynb) |
| **3. Guanaco Chatbot Demo with LLaMA-7B Model** | Showcase of a chatbot demo powered by LLaMA-7B model. | [](https://colab.research.google.com/github/ashishpatel26/LLM-Finetuning/blob/main/3.Guanaco%20Chatbot%20Demo%20with%20LLaMA-7B%20Model.ipynb) |
| **4. PEFT Finetune-Bloom-560m-tagger** | Project details for PEFT Finetune-Bloom-560m-tagger. | [](https://colab.research.google.com/github/ashishpatel26/LLM-Finetuning/blob/main/4.PEFT%20Finetune-Bloom-560m-tagger.ipynb#scrollTo=MDqJWba-tpnv) |
| **5. Finetune_Meta_OPT-6-1b_Model_bnb_peft** | Details and guide for finetuning the Meta OPT-6-1b Model using PEFT and Bloom-560m-tagger. | [](https://colab.research.google.com/github/ashishpatel26/LLM-Finetuning/blob/main/5.Finetune_Meta_OPT-6-1b_Model_bnb_peft.ipynb) |
| **6.Finetune Falcon-7b with BNB Self Supervised Training** | Guide for finetuning Falcon-7b using BNB self-supervised training. | [](https://colab.research.google.com/github/ashishpatel26/LLM-Finetuning/blob/main/6.Finetune%20Falcon-7b%20with%20BNB%20Self%20Supervised%20Training.ipynb) |
| **7.FineTune LLaMa2 with QLoRa** | Guide to fine-tune the Llama 2 7B pre-trained model using the PEFT library and QLoRa method | [](https://colab.research.google.com/github/ashishpatel26/LLM-Finetuning/blob/main/7.FineTune_LLAMA2_with_QLORA.ipynb) |
| **8.Stable_Vicuna13B_8bit_in_Colab** | Guide of Fine Tuning Vecuna 13B_8bit | [](https://colab.research.google.com/github/ashishpatel26/LLM-Finetuning/blob/main/8.Stable_Vicuna13B_8bit_in_Colab.ipynb) |
| **9. GPT-Neo-X-20B-bnb2bit_training** | Guide How to train the GPT-NeoX-20B model using bfloat16 precision | [](https://colab.research.google.com/github/ashishpatel26/LLM-Finetuning/blob/main/9.GPT-neo-x-20B-bnb_4bit_training.ipynb) |
| **10. MPT-Instruct-30B Model Training** | MPT-Instruct-30B is a large language model from MosaicML that is trained on a dataset of short-form instructions. It can be used to follow instructions, answer questions, and generate text. | [](https://colab.research.google.com/github/ashishpatel26/LLM-Finetuning/blob/main/10.MPT_Instruct_30B.ipynb) |
| **11.RLHF_Training_for_CustomDataset_for_AnyModel** | How train a Model with RLHF training on any LLM model with custom dataset | [](https://colab.research.google.com/github/ashishpatel26/LLM-Finetuning/blob/main/11_RLHF_Training_for_CustomDataset_for_AnyModel.ipynb) |
| **12.Fine_tuning_Microsoft_Phi_1_5b_on_custom_dataset(dialogstudio)** | How train a model with trl SFT Training on Microsoft Phi 1.5 with custom | [](https://colab.research.google.com/github/ashishpatel26/LLM-Finetuning/blob/main/12_Fine_tuning_Microsoft_Phi_1_5b_on_custom_dataset(dialogstudio).ipynb) |
| **13. Finetuning OpenAI GPT3.5 Turbo** | How to finetune GPT 3.5 on your own data | [](https://colab.research.google.com/github/ashishpatel26/LLM-Finetuning/blob/main/13.Fine_tuning_OpenAI_GPT_3_5_turbo.ipynb) |
| **14. Finetuning Mistral-7b FineTuning Model using Autotrain-advanced** | How to finetune Mistral-7b using autotrained-advanced | [](https://colab.research.google.com/github/ashishpatel26/LLM-Finetuning/blob/main/14.Finetuning_Mistral_7b_Using_AutoTrain.ipynb) |
| **15. RAG LangChain Tutorial** | How to Use RAG using LangChain | [](https://colab.research.google.com/github/ashishpatel26/LLM-Finetuning/blob/main/15.RAG_LangChain.ipynb) |
| **16. Knowledge Graph LLM with LangChain PDF Question Answering** | How to build knowledge graph with pdf question answering | [](https://colab.research.google.com/github/ashishpatel26/LLM-Finetuning/blob/main/16.Neo4j_and_LangChain_for_Enhanced_Question_Answering.ipynb) |
| **17. Text to Knolwedge Graph with OpenAI Function with Neo4j and Langchain Agent Question Answering** | How to build knowledge graph from text or Pdf Document with pdf question Answering | [](https://colab.research.google.com/github/ashishpatel26/LLM-Finetuning/blob/main/17.OpenAI_Constructing_Graph_for_Questio_Answer.ipynb) |
| **18. Convert the Document to Knowledgegraph using Langchain and Openai** | This notebook is help you to understand how easiest way you can convert your any documents into Knowledgegraph for your next RAG based Application | [](https://colab.research.google.com/github/ashishpatel26/LLM-Finetuning/blob/main/18.Convert_Document_to_Knowledge_Graph_Langchain_Openai.ipynb) |
| **19. How to train a 1-bit Model with LLMs?** | This notebook is help you to train a model with 1-bit and 2-bit quantization method using hqq framework | [](https://colab.research.google.com/github/ashishpatel26/LLM-Finetuning/blob/main/19.HQQ_1bit_ipynb.ipynb) |
| **20.Alpaca_+_Gemma2_9b_Unsloth_2x_faster_finetuning** | This notebook is help you to train a model with gemma2 9b | [](https://colab.research.google.com/github/ashishpatel26/LLM-Finetuning/blob/main/20.Alpaca_%2B_Gemma2_9b_Unsloth_2x_faster_finetuning.ipynb) |
| **21.RAG Pipeline Evaluation Using MLFLOW Best Industry Practice** | This notebook provides a comprehensive guide to evaluating the 21 RAG (Retrieve-then-Answer Generation) pipeline using MLFLOW, adhering to best industry practices. | [](https://colab.research.google.com/github/ashishpatel26/LLM-Finetuning/blob/main/21_RAG_Pipeline_Evaluation_Using_MLFLOW_Best_Industry_Practise.ipynb) |
| **22. Evaluate a Hugging Face LLM with `mlflow.evaluate()`** | This notebook provides a comprehensive guide on evaluating a Hugging Face Language Learning Model (LLM) using mlflow_evaluate. | [](https://colab.research.google.com/github/ashishpatel26/LLM-Finetuning/blob/main/22.Evaluate_a_Hugging_Face_LLM_with_mlflow_evaluate.ipynb) |
## Contributing 🤝
Contributions are welcome! If you'd like to contribute to this project, feel free to open an issue or submit a pull request.
## License 📝
This project is licensed under the [MIT License](LICENSE).
---
Created with ❤️ by [Ashish](https://github.com/ashishpatel26/)