https://github.com/michaelnny/QLoRA-LLM

A simple custom QLoRA implementation for fine-tuning a language model (LLM) with basic tools such as PyTorch and Bitsandbytes, completely decoupled from Hugging Face.
https://github.com/michaelnny/QLoRA-LLM

4bit-quantize custom-model fine-tuning llama llm qlora

Last synced: 3 days ago
JSON representation

A simple custom QLoRA implementation for fine-tuning a language model (LLM) with basic tools such as PyTorch and Bitsandbytes, completely decoupled from Hugging Face.

• Host: GitHub
• URL: https://github.com/michaelnny/QLoRA-LLM
• Owner: michaelnny
• License: mit
• Archived: true
• Created: 2023-12-13T14:08:35.000Z (about 1 year ago)
• Default Branch: main
• Last Pushed: 2024-01-29T07:50:59.000Z (12 months ago)
• Last Synced: 2024-10-18T23:15:54.785Z (3 months ago)
• Topics: 4bit-quantize, custom-model, fine-tuning, llama, llm, qlora
• Language: Python
• Homepage:
• Size: 26 MB
• Stars: 3
• Watchers: 1
• Forks: 1
• Open Issues: 1
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• awesome_ai_agents - Qlora-Llm - A simple custom QLoRA implementation for fine-tuning a language model (LLM) with basic tools such as PyTorch and Bitsandbytes, completely… (Building / Tools)
• awesome_ai_agents - Qlora-Llm - A simple custom QLoRA implementation for fine-tuning a language model (LLM) with basic tools such as PyTorch and Bitsandbytes, completely… (Building / Tools)