https://github.com/NVIDIA/workbench-llamafactory

This is an NVIDIA AI Workbench example project that demonstrates an end-to-end model development workflow using Llamafactory.
https://github.com/NVIDIA/workbench-llamafactory

Last synced: 26 days ago
JSON representation

This is an NVIDIA AI Workbench example project that demonstrates an end-to-end model development workflow using Llamafactory.

• Host: GitHub
• URL: https://github.com/NVIDIA/workbench-llamafactory
• Owner: NVIDIA
• License: apache-2.0
• Created: 2024-05-31T20:07:30.000Z (9 months ago)
• Default Branch: main
• Last Pushed: 2024-10-17T02:30:19.000Z (4 months ago)
• Last Synced: 2025-01-01T04:05:57.080Z (about 1 month ago)
• Language: Jupyter Notebook
• Size: 276 KB
• Stars: 42
• Watchers: 2
• Forks: 15
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• awesome-LLM-resourses - workbench-llamafactory - to-end model development workflow using Llamafactory. (微调 Fine-Tuning)
• StarryDivineSky - NVIDIA/workbench-llamafactory
• alan_awesome_llm - workbench-llamafactory - to-end model development workflow using Llamafactory. (微调 Fine-Tuning)
• alan_awesome_llm - workbench-llamafactory - to-end model development workflow using Llamafactory. (微调 Fine-Tuning)

README

        
## LLaMA-Factory - AI Workbench Project

This is an [NVIDIA AI Workbench](https://www.nvidia.com/en-us/deep-learning-ai/solutions/data-science/workbench/) project to deploy [LLaMA-Factory](https://github.com/hiyouga/LLaMA-Factory).

**Please follow the LLM fine-tuning tutorial for [RTX AI Toolkit here](https://github.com/NVIDIA/RTX-AI-Toolkit/blob/main/tutorial-llama3-finetune.md).**



Minimum recommended Workbench ver: 0.50.16

Docker Desktop ver. 4.31+

## Features

- Fine-tune an LLM using Llama factory.

- Fuse generated LoRA adapter with the base model.

- Apply Post Training Quantization to your model.

- Export model to TensorRT-LLM checkpoint.

- Support for unsloth.