Projects in Awesome Lists tagged with finetuning

https://github.com/unslothai/unsloth

Finetune Llama 3.1, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory

ai fine-tuning finetuning gemma llama llama3 llms lora mistral phi3 qlora unsloth

Last synced: 29 Sep 2024

https://github.com/meta-llama/llama-recipes

Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama3 for WhatsApp & Messenger.

ai finetuning langchain llama llama2 llm machine-learning python pytorch vllm

Last synced: 26 Sep 2024

https://github.com/facebookresearch/llama-recipes

Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama3 for WhatsApp & Messenger.

ai finetuning langchain llama llama2 llm machine-learning python pytorch vllm

Last synced: 05 Sep 2024

https://github.com/microsoft/flaml

A fast library for AutoML and tuning. Join our Discord: https://discord.gg/Cppx2vSPVP.

automated-machine-learning automl classification data-science deep-learning finetuning hyperparam hyperparameter-optimization jupyter-notebook machine-learning natural-language-generation natural-language-processing python random-forest regression scikit-learn tabular-data timeseries-forecasting tuning

Last synced: 29 Sep 2024

https://github.com/microsoft/FLAML

A fast library for AutoML and tuning. Join our Discord: https://discord.gg/Cppx2vSPVP.

automated-machine-learning automl classification data-science deep-learning finetuning hyperparam hyperparameter-optimization jupyter-notebook machine-learning natural-language-generation natural-language-processing python random-forest regression scikit-learn tabular-data timeseries-forecasting tuning

Last synced: 31 Jul 2024

https://github.com/h2oai/h2o-llmstudio

H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://h2oai.github.io/h2o-llmstudio/

ai chatbot chatgpt fine-tuning finetuning generative generative-ai gpt llama llama2 llm llm-training

Last synced: 27 Sep 2024

https://github.com/linkedin/liger-kernel

Efficient Triton Kernels for LLM Training

finetuning gemma2 llama llama3 llm-training llms mistral phi3 triton triton-kernels

Last synced: 27 Sep 2024

https://github.com/dataherald/dataherald

Interact with your SQL database, Natural Language to SQL using LLMs

ai database finetuning llm nl-to-sql rag sql text-to-sql

Last synced: 30 Sep 2024

https://github.com/Dataherald/dataherald

Interact with your SQL database, Natural Language to SQL using LLMs

ai database finetuning llm nl-to-sql rag sql text-to-sql

Last synced: 01 Aug 2024

https://github.com/learnables/learn2learn

A PyTorch Library for Meta-learning Research

few-shot finetuning learn2learn learning2learn maml meta-descent meta-learning meta-optimization meta-rl metalearning pytorch

Last synced: 29 Sep 2024

https://github.com/stochasticai/xturing

Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6

adapter alpaca deep-learning fine-tuning finetuning gen-ai generative-ai gpt-2 gpt-j language-model llama llm lora mistral mixed-precision peft quantization

Last synced: 27 Sep 2024

https://github.com/stochasticai/xTuring

Build, customize and control you own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: https://discord.gg/TgHXuSJEk6

adapter alpaca deep-learning fine-tuning finetuning gen-ai generative-ai gpt-2 gpt-j language-model llama llm lora mistral mixed-precision peft quantization

Last synced: 30 Jul 2024

https://github.com/jina-ai/finetuner

:dart: Task-oriented embedding tuning for BERT, CLIP, etc.

bert few-shot-learning fine-tuning finetuning jina metric-learning negative-sampling neural-search openai-clip pretrained-models siamese-network similarity-learning transfer-learning triplet-loss

Last synced: 30 Sep 2024

https://github.com/lazyagi/lazyllm

Easiest and laziest way for building multi-agent LLMs applications.

agents ai-agent data deep-learning documentation-tool finetuning framework knowlege-graph langchain lazyllm llamaindex llm llms rag

Last synced: 01 Oct 2024

https://github.com/georgian-io/llm-finetuning-toolkit

Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.

ablation-study classification falcon fine-tuning finetuning flan-t5 large-language-models llama2 llm-test lora mistral-7b nlp nlp-machine-learning qlora redpajama summarization unit-testing zephyr

Last synced: 27 Sep 2024

https://github.com/georgian-io/LLM-Finetuning-Toolkit

Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.

ablation-study classification falcon fine-tuning finetuning flan-t5 large-language-models llama2 llm-test lora mistral-7b nlp nlp-machine-learning qlora redpajama summarization unit-testing zephyr

Last synced: 01 Aug 2024

https://github.com/georgian-io/LLM-Finetuning-Hub

Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.

ablation-study classification falcon fine-tuning finetuning flan-t5 large-language-models llama2 llm-test lora mistral-7b nlp nlp-machine-learning qlora redpajama summarization unit-testing zephyr

Last synced: 12 Aug 2024

https://github.com/LazyAGI/LazyLLM

Easyest and lazyest way for building multi-agent LLMs applications.

agents ai-agent data deep-learning documentation-tool finetuning framework knowlege-graph langchain lazyllm llamaindex llm llms rag

Last synced: 02 Aug 2024

https://github.com/minosvasilias/godot-dodo

Finetuning large language models for GDScript generation.

ai finetuning gdscript godot llama

Last synced: 29 Sep 2024

https://github.com/microsoft/AzureML-BERT

End-to-End recipes for pre-training and fine-tuning BERT using Azure Machine Learning Service

azure-machine-learning azureml-bert bert bert-model finetuning language-model nlp pretrained-models pretraining pytorch tuning

Last synced: 07 Aug 2024

https://github.com/Microsoft/AzureML-BERT

End-to-End recipes for pre-training and fine-tuning BERT using Azure Machine Learning Service

azure-machine-learning azureml-bert bert bert-model finetuning language-model nlp pretrained-models pretraining pytorch tuning

Last synced: 01 Aug 2024

https://github.com/LHRLAB/ChatKBQA

ChatKBQA: A Generate-then-Retrieve Framework for Knowledge Base Question Answering with Fine-tuned Large Language Models

finetuning graph-database knowledge-graph large-language-models semantic-parsing sparql-query

Last synced: 03 Aug 2024

https://github.com/sozercan/aikit

🏗️ Fine-tune, build, and deploy open-source LLMs easily!

ai buildkit chatgpt docker fine-tuning finetuning gemma gpt inference kubernetes large-language-models llama llama2 llm localllama mistral mixtral nvidia open-source-llm openai

Last synced: 27 Sep 2024

https://github.com/Trainy-ai/llm-atc

Fine-tuning and serving LLMs on any cloud

finetuning llama2 llms vllm

Last synced: 02 Aug 2024

https://github.com/zjysteven/lmms-finetune

A minimal codebase for finetuning large multimodal models, supporting llava-1.5, qwen-vl, llava-interleave, llava-next-video, phi3-v etc.

finetuning foundation-models instruction-tuning large-language-model large-multimodal-models llava llava-next multimodal multimodal-large-language-models qwen-vl vision-language visual-instruction-tuning

Last synced: 02 Aug 2024

https://github.com/speediedan/finetuning-scheduler

A PyTorch Lightning extension that accelerates and enhances foundation model experimentation with flexible fine-tuning schedules.

artificial-intelligence fine-tuning finetuning machine-learning neural-networks pytorch pytorch-lightning superglue transfer-learning

Last synced: 01 Aug 2024

https://github.com/adithya-s-k/companionllm

CompanionLLM - A framework to finetune LLMs to be your own sentient conversational companion

fine-tuning finetuning hacktoberfest hacktoberfest-accepted hacktoberfest2023 huggingface llama llama2 llamacpp llm llm-inference llm-training lora mit-license open-source peft

Last synced: 27 Sep 2024

https://github.com/chuangchuangtan/llava-next-image-llama3-lora

LLaVA-NeXT-Image-Llama3-Lora, Modified from https://github.com/arielnlee/LLaVA-1.6-ft

finetuning llama3 llava-next lora

Last synced: 27 Sep 2024

https://github.com/gurpreetkaurjethra/generative-ai-llm-projects

Gen AI Large Language Model Projects

artificial-intelligence finetune-llm finetuning gemini generative-ai gpt4-api gpt4o langchain large-language-models llama llama3 llama3-meta-ai llm mistral openai rag

Last synced: 27 Sep 2024

https://github.com/conneroisu/Text-Dataset-Aid-Plugin

This is a obsidian plugin to help with the creation of personal datasets for text generation models.

fine-tuning finetuning language-model obsidian obsidian-md obsidian-plugin plugin

Last synced: 07 Aug 2024

https://github.com/HomoScriptor-Project/HomoScriptor

Fuel innovation and advance language models with HomoScriptor: A vibrant, community-driven dataset for fine-tuning large language models.

dataset datasets fine-tuning finetuning llm

Last synced: 09 Aug 2024

https://github.com/gallen881/physics_master

Physics Master is a model fine-tuned from llama3-8B-Instruct. It can answer your physics question!

ai fine-tuning finetune finetuning llama3 llm physics

Last synced: 01 Oct 2024

https://github.com/zeyadusf/finetuning-llms

Finetuning Large Language Models

bert-model deberta distilbert finetuning finetuning-llms llama2 llms lora peft-fine-tuning-llm quantization roberta summarization t5-model text-classification text-generation

Last synced: 01 Oct 2024

https://github.com/muneeb1030/finetune-tiny-llama

Fine-tuning the Tiny Llama model to mimic my professor's writing style using the Llama Factory. The project involves data collection, preprocessing, preparation, fine-tuning, and evaluation.

data data-preparation data-preprocessing finetuning llama-factory llm pymupdf selenium-python spacy tinyllama webscraping

Last synced: 30 Sep 2024

https://github.com/rs-py/howtofinetunellama3.1

Quick tutorial showing how to fine-tune Llama3.1 with nothing but free tools and text data. All code included in ipynb. For a step by step walkthrough take a look at the tutorial below on medium.

fine-tuning finetuning huggingface llama3 llm llm-training

Last synced: 01 Oct 2024

https://github.com/amithkoujalgi/llama3-playground

A fully-contained, ready-to-run environment to finetune Llama 3 model with custom dataset and run inference on the fine-tuned models

fine-tune fine-tuning finetune finetuning gen-ai genai generative-ai language-model large-language-models llama llama3 llm model-finetuning model-training ocr pdf-ai playground training

Last synced: 26 Sep 2024