https://github.com/p1atdev/vision-ft
https://github.com/p1atdev/vision-ft
Last synced: about 1 year ago
JSON representation
- Host: GitHub
- URL: https://github.com/p1atdev/vision-ft
- Owner: p1atdev
- License: apache-2.0
- Created: 2024-12-21T15:18:44.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2025-04-05T14:37:53.000Z (about 1 year ago)
- Last Synced: 2025-04-05T15:28:29.071Z (about 1 year ago)
- Language: Python
- Size: 1.25 MB
- Stars: 5
- Watchers: 1
- Forks: 0
- Open Issues: 3
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Vision model finetuning scripts
WIP
## Features
- NF4 model loading
- QLoRA with bitsandbytes
- [Flash Attention](https://github.com/Dao-AILab/flash-attention) support
- Aspect ratio bucketing
### Models
- [x] SDXL
- [x] AuraFlow
- [ ] Flux & Flex (WIP)
- [ ] CogView4 (WIP)
- [ ] FractalGen (TODO)
- [ ] Wan 2.1 (TODO)
## Setup
```bash
uv sync --extra build
uv sync --all-extras
```
## References
- https://github.com/kohya-ss/sd-scripts
- Heavily inspired by this repository.
- https://github.com/cloneofsimo/minRF
- https://github.com/huggingface/diffusers
- https://github.com/Stability-AI/sd3-ref
- https://github.com/black-forest-labs/flux
- Model implementation
- https://github.com/microsoft/LoRA
- https://github.com/huggingface/peft
- Peft logic and implementation
- https://github.com/huggingface/diffusers
- https://github.com/Lightning-AI/pytorch-lightning
- https://github.com/ostris/ai-toolkit
- Traning cycle and API design
- https://github.com/NovelAI/novelai-aspect-ratio-bucketing
- Aspect ratio bucketing
- https://github.com/bitsandbytes-foundation/bitsandbytes
- Quantization