Projects in Awesome Lists tagged with peft-fine-tuning-llm

https://github.com/peremartra/large-language-model-notebooks-course

Practical course about Large Language Models.

chatbots fine-tuning-llm hf huggingface langchain large-language-models peft-fine-tuning-llm pruning transformers vector-database

Last synced: 11 Apr 2025

https://github.com/peremartra/Large-Language-Model-Notebooks-Course

Practical course about Large Language Models.

chatbots fine-tuning-llm hf huggingface langchain large-language-models peft-fine-tuning-llm pruning transformers vector-database

Last synced: 09 Apr 2025

https://github.com/tudb-labs/moe-peft

An Efficient LLM Fine-Tuning Factory Optimized for MoE PEFT

mixlora mlora peft peft-fine-tuning-llm

Last synced: 05 Apr 2025

https://github.com/misonsky/hift

memory-efficient fine-tuning; support 24G GPU memory fine-tuning 7B

chinese-llama chinese-llama-65b huggingface-transformers large-language-models llama2 llama3 lora memory-efficient-tuning peft-fine-tuning-llm pytorch-implementation transformers

Last synced: 03 Dec 2024

https://github.com/prithivsakthiur/gallo-3xl

High Quality Image Generation Model - Powered with NVIDIA A100

ai dall-e dalle2 dalle3 diffusers gradio huggingface image-generation peft peft-fine-tuning-llm text-to-image torch transformers

Last synced: 17 Dec 2024

https://github.com/dvgodoy/finetuningllms

Official repository of the book "A Hands-On Guide to Fine-Tuning LLMs" with PyTorch and Hugging Face

bitsandbytes fine-tuning finetuning finetuning-llms hugging-face huggingface large-language-models llamacpp lora ollama peft peft-fine-tuning-llm pytorch transformers

Last synced: 27 Jan 2025

https://github.com/zeyadusf/topics-in-nlp-llm

In this repo I will share different topics on anything I want to know in nlp and llms

bpe llms lora nlp peft peft-fine-tuning-llm quantization

Last synced: 25 Feb 2025

https://github.com/himanshuvnm/foundation-model-large-language-model-fm-llm

This repository was commited under the action of executing important tasks on which modern Generative AI concepts are laid on. In particular, we focussed on three coding actions of Large Language Models. Extra and necessary details are given in the README.md file.

attention-is-all-you-need aws fine-tuning flan-t5 foundation-models generative-ai hate-speech-detection huggingface huggingface-transformers large-language-models lora low-rank-ada ml-m5-2xlarge peft-fine-tuning-llm python3 pytorch rlhf rnn-pytorch

Last synced: 17 Feb 2025

https://github.com/zeyadusf/finetuning-llms

Finetuning Large Language Models

bert-model deberta distilbert finetuning finetuning-llms llama2 llms lora peft-fine-tuning-llm quantization roberta summarization t5-model text-classification text-generation

Last synced: 10 Apr 2025

https://github.com/arya920/natural_language_to_sql_queries

The task of this project is to Convert Natural Language to SQL Queries

deepseek-coder gemma-2b huggingface-datasets huggingface-transformer lora mysql-database peft-fine-tuning-llm sqllite streamlit transformers

Last synced: 26 Mar 2025

https://github.com/eshan1347/gpt-neo-lora

A GPT-Neo model is fine tuned on a custom dataset using huggingface transformers package

deep-learning finetuning-llms gpt2 huggingface-transformers peft-fine-tuning-llm

Last synced: 23 Mar 2025

https://github.com/aman-17/medisoap

FineTuning LLMs on conversational medical dataset.

fine-tuning generative-ai llama llama-2 llm-training lora medical peft peft-fine-tuning-llm qlora summarization

Last synced: 20 Mar 2025

https://github.com/zeyadusf/summarization-by-finetuning-flant5-lora

fine-tuning llm lora nlp peft peft-fine-tuning-llm summarization

Last synced: 25 Feb 2025

https://github.com/sathviknayak123/agentic-rag

Agentic RAG with Llama-3.1-8b model Fine-tuned on medical conversational dataset

agentic-rag chromadb context-aware-chat fastapi huggingface langchain langgraph llama3 ollama peft-fine-tuning-llm qlora quantization rag rouge-evaluation unsloth

Last synced: 01 Mar 2025

https://github.com/nikisetti01/mtl-lora-for-pubmedqa-and-riddle

🚀 Fine-tuning LLaMA 1B for a medical chatbot using LoRA and a custom MTL-LoRA framework in PyTorch, enabling efficient multi-task learning for medical NLP! 🏥💡

ai fine-tuning llm lora peft-fine-tuning-llm pytorch

Last synced: 21 Feb 2025

https://github.com/ajithvcoder/emlo4-session-09-ajithvcoder

Deploying a Vision model with LitServe and a LLM - llama3.2 model with litserve from The School of AI EMLO-V4 course assignment https://theschoolof.ai/#programs

api-development litserve llama-3-2-1b llama3-2 llm-api-development lora peft-fine-tuning-llm

Last synced: 21 Feb 2025

https://github.com/ohmatheus/kaggle_wsdmcup_multilingual_chatbot_arena

My project for Kaggle's WSDM 2025 cup. Big project where I fuze gemma2-9b and some feature engineering for sequence classification.

4bit ddp feature-engineering gemma2 nlp-machine-learning peft-fine-tuning-llm runpod-worker

Last synced: 22 Feb 2025

https://github.com/chatterjeesaurabh/dialogue-summarization-with-large-language-model

Explored In-Context prompt learning, Full Fine-Tuning, Parameter-Efficient Fine-Tuning (PEFT) with LoRA, and Fine-tune with Reinforcement Learning (PPO) to generate less-toxic summaries.

fine-tuning generative-ai llm peft-fine-tuning-llm

Last synced: 23 Feb 2025

https://github.com/0xzee/finetune_model_dataset

Fine-Tunning Model llama3.2 on local Dataset using LoRA, QLoRA and PEFT..

huggingface huggingface-transformers llama3-2 lora peft-fine-tuning-llm qlora

Last synced: 27 Mar 2025

https://github.com/paraglondhe098/sentiment-classification-llm

Implemented and fine-tuned BERT for a custom sequence classification task, leveraging LoRA adapters for efficient parameter updates and 4-bit quantization to optimize performance and resource utilization.

data-augmentation llm llm-fine-tuning llm-quantization lora nlp nlp-augmentation peft-fine-tuning-llm qlora quantization

Last synced: 23 Feb 2025

https://github.com/myriamba/dialogue-summarizer

An End-to-End Dialogue Summarization Project using LLM.

fine-tuning flan-t5 generative-ai huggingface-transformers llm peft-fine-tuning-llm prompt-engineering

Last synced: 21 Mar 2025

https://github.com/aman-17/MediSOAP

FineTuning LLMs on conversational medical dataset.

fine-tuning generative-ai llama llama-2 llm-training lora medical peft peft-fine-tuning-llm qlora summarization

Last synced: 06 Jan 2025

https://github.com/satyampurwar/large-language-models

Unlocking the Power of Generative AI: In-Context Learning, Instruction Fine-Tuning and Reinforcement Learning Fine-Tuning.

bert conda-environment encoder-decoder-model encoder-model few-shot-prompting flan-t5 generative-ai instruction-fine-tuning kl-divergence large-language-models low-rank-adaptation megacmd memory-management model-quantization peft-fine-tuning-llm prompt-engineering proximal-policy-optimization reinforcement-learning-from-ai-feedback reinforcement-learning-from-human-feedback storage-management

Last synced: 21 Feb 2025

https://github.com/mafda/lightweight_fine_tuning_project

This repository provides a Jupyter notebook demonstrating parameter-efficient fine-tuning (PEFT) with LoRA on Hugging Face models.

huggingface huggingface-datasets huggingface-transformers lora peft peft-fine-tuning-llm pytorch

Last synced: 06 Mar 2025

https://github.com/rathod-shubham/finetuning-llms

This repository contains experiments on fine-tuning LLMs (Llama, Llama3.1, Gemma). It includes notebooks for model tuning, data preprocessing, and hyperparameter optimization to enhance model performance.

adapter colab-notebook dpo fine-tuning gemma huggingface llama llm lora peft-fine-tuning-llm python qlora stf transformer unsloth