An open API service indexing awesome lists of open source software.

Projects in Awesome Lists tagged with 4bit-quantize

A curated list of projects in awesome lists tagged with 4bit-quantize .

https://github.com/shaheennabi/production-ready-instruction-finetuning-of-meta-llama-3.2-3b-instruct-project

๐ŸŽ‹๐ŸŒฟ๐ŸŒŸ Instruction Fine-Tuning of Meta Llama 3.2-3B Instruct on Kannada Conversations ๐ŸŒŸ๐ŸŒฟ๐ŸŽ‹ Tailoring the model to follow specific instructions in Kannada, enhancing its ability to generate relevant, context-aware responses based on conversational inputs. ๐Ÿš€โœจ Using the Kannada Instruct dataset for fine-tuning! Happy Finetuning๐ŸŽ‡๐ŸŽ‰

4bit-quantize 4bitprecision anthropic-hh-golden bitsandbytes deployed finetuning gguf gpu huggingface inference meta modular-code open-source peft production-ready qlora quantization training unified-language-model-aligning unsloth

Last synced: 31 Jan 2025

https://github.com/michaelnny/QLoRA-LLM

A simple custom QLoRA implementation for fine-tuning a language model (LLM) with basic tools such as PyTorch and Bitsandbytes, completely decoupled from Hugging Face.

4bit-quantize custom-model fine-tuning llama llm qlora

Last synced: 06 Jan 2025

https://github.com/luluw8071/llama2-llm-7b-text-generation

Text Generation on Pre-Trained NousResearchโ€™s Llama-2-7b-chat-hf using guanaco-llama2-1k dataset

4bit-quantize huggingface llama2 llm pytorch text-generation

Last synced: 28 Feb 2025

https://github.com/ulianadzhumok/meeting_key_points_ai

Sample project with combination of Whisper and Deepseek R1 for extracting key points from office meeting videos

4bit-quantize ai deepseek-r1 dora finetuning llm lora quantization speech-to-text summarization unsloth whisper whisper-ai

Last synced: 08 Mar 2025