Projects in Awesome Lists tagged with bitsandbytes
A curated list of projects in awesome lists tagged with bitsandbytes .
https://github.com/bobazooba/xllm
🦖 X—LLM: Cutting Edge & Easy LLM Finetuning
alpaca bitsandbytes cerebras chatgpt deep-learning deep-neural-networks gpt gpt-4 gptq large-language-models llama llama2 llm mistral openai pytorch torch vicuna zephyr
Last synced: 04 Apr 2025
https://github.com/dvgodoy/finetuningllms
Official repository of my book "A Hands-On Guide to Fine-Tuning LLMs with PyTorch and Hugging Face"
bitsandbytes fine-tuning finetuning finetuning-llms hugging-face huggingface large-language-models llamacpp lora ollama peft peft-fine-tuning-llm pytorch transformers
Last synced: 09 Oct 2025
https://github.com/shaheennabi/production-ready-instruction-finetuning-of-meta-llama-3.2-3b-instruct-project
Instruction Fine-Tuning of Meta Llama 3.2-3B Instruct on Kannada Conversations. Tailoring the model to follow specific instructions in Kannada, enhancing its ability to generate relevant, context-aware responses based on conversational inputs. Using the Kannada Instruct dataset for fine-tuning! Happy Finetuning 🎋
4bit-quantize 4bitprecision anthropic-hh-golden bitsandbytes deployed finetuning gguf gpu huggingface inference meta modular-code open-source peft production-ready qlora quantization training unified-language-model-aligning unsloth
Last synced: 26 Oct 2025
https://github.com/eljandoubi/ai-photo-editing-with-inpainting
A web app that allows you to select a subject and then change its background, OR keep the background and change the subject.
bitsandbytes gradio-interface huggingface-accelerate huggingface-diffusers huggingface-transformers pytroch
Last synced: 07 May 2025
https://github.com/antonio-f/orca2
Orca 2 on Colab
accelerate artificial-intelligence bitsandbytes colab-notebook google-colab hands-on huggingface-transformers jupyter-notebook language-model llms orca-2 python pytorch-implementation tutorial
Last synced: 14 Apr 2025
https://github.com/bobazooba/shurale
Conversation AI model for open domain dialogs
bitsandbytes cerebras chatgpt deep-learning deep-neural-networks gpt gpt-4 gptq large-language-models llama llama2 llm mistral natural-language-processing nlp openai pytorch torch transformers vicuna
Last synced: 05 Oct 2025
https://github.com/11sshukla/model_quantization
Quantizing TinyLlama to 8-bit
accelerator bitsandbytes touch transformer
Last synced: 01 Nov 2025
https://github.com/md-emon-hasan/fine-tuning
End-to-end fine-tuning of Hugging Face models using LoRA, QLoRA, quantization, and PEFT techniques. Optimized for low-memory with efficient model deployment
bitsandbytes deep-learning fine-tuning fp16-training gpu-optimization gradient-checkpointing huggingface huggingface-datasets lora low-memory-training machine-learning model-training natural-language-processing nlp parameter-efficient-fine-tuning peft pytorch qlora quantization transformers
Last synced: 23 Jul 2025
https://github.com/bushra-butt-17/budgetbuddy-finance-chatbot
Budget Buddy is a finance chatbot built using Chainlit and the LLaMA language model. It analyzes PDF documents, such as bank statements and budget reports, to provide personalized financial advice and insights. The chatbot is integrated with Hugging Face for model management, offering an interactive way to manage personal finances.
accelerate bitsandbytes chainlit chatbot ctransformers embeddings faiss-cpu faiss-vector-database huggingface-hub huggingface-transformers langchain langchain-community llama mini-llm pdf-parse pypdf sentence-transformers torch vector-store
Last synced: 30 Mar 2025
https://github.com/arjunravi26/ai_psychologist
Fine tune llama 2 model with mental health counseling data from huggingface
accelerate bitsandbytes llama lora peft python qlora streamlit torch transformer
Last synced: 16 Oct 2025
https://github.com/edcalderin/huggingface_ragflow
This project implements a classic Retrieval-Augmented Generation (RAG) system using HuggingFace models with quantization techniques. The system processes PDF documents, extracts their content, and enables interactive question-answering through a Streamlit web application.
bitsandbytes cuda huggingface huggingface-embeddings langchain langchain-community large-language-models llm nf4 python qdrant quantization rag retrieval-augmented-generation ruff streamlit text-generation
Last synced: 15 Jul 2025
https://github.com/varun0157/quantisation
Experiments in quantisation consisting of quantisation from scratch, bitsandbytes, and llama.cpp. [Assignment 4 of Advanced Natural Language Processing, IIIT-H Monsoon '24]
bitsandbytes llamacpp natural-language-processing quantisation
Last synced: 26 Oct 2025
https://github.com/architj6/llama2-finetuning
🦙 Llama2-FineTuning: Fine-tune LLAMA 2 with Custom Datasets Using LoRA and QLoRA Techniques
bitsandbytes fine-tuning fine-tuning-llama2 fine-tuning-llm google-colab huggingface large-language-models llama2 lora low-rank-adaptation nlp peft pytorch qlora quantization supervised-fine-tuning text-generation transformer-reinforcement-learning transformers
Last synced: 19 Apr 2025
https://github.com/403errors/cancercareai
An AI-powered system for extracting cancer-related information from patient Electronic Health Record (EHR) notes
accelerate bitsandbytes information-retrieval local-llm-integration nlp-machine-learning nltk-python optimum pipelines pro prompt-engineering requests-library-python sentence-transformers torch transformers
Last synced: 09 Feb 2026
https://github.com/sccsmartcode/deep-learning-03-llm-finetuning
Scalable and modular framework for fine-tuning large language models (LLMs) using LoRA and QLoRA. Supports 4-bit/8-bit quantization, Hugging Face Transformers, and instruction-tuning workflows across various tasks and datasets. Built for reproducibility, extensibility, and efficient experimentation.
bitsandbytes finetuning huggingface llama2 llm peft qlora transformers
Last synced: 04 Jul 2025
