Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/cbh123/youtune
Fine tune SDXL on YouTube videos
https://github.com/cbh123/youtune
Last synced: 3 months ago
JSON representation
Fine tune SDXL on YouTube videos
- Host: GitHub
- URL: https://github.com/cbh123/youtune
- Owner: cbh123
- Created: 2023-10-26T22:51:49.000Z (about 1 year ago)
- Default Branch: main
- Last Pushed: 2023-11-07T14:12:47.000Z (about 1 year ago)
- Last Synced: 2024-04-12T19:53:05.642Z (7 months ago)
- Language: Python
- Homepage:
- Size: 40 KB
- Stars: 167
- Watchers: 6
- Forks: 18
- Open Issues: 4
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
- awesome-replicate - youtune - Fine-tune SDXL and MusicGen models on YouTube videos. (Built with Replicate)
README
# YouTune
[YouTune Video Walkthrough](https://www.loom.com/share/193fa040b8074f44bb5ddabd4dd42b01?sid=4b09aa1b-5cd6-4e4f-a538-d3d62cb1bdc0)
YouTune makes it really easy to:
- fine-tune SDXL on images from YouTube videos
- fine-tune MusicGen on audio from YouTube videos
## Fine-tuning SDXL
Just give it a URL and a model name on Replicate, and it’ll download the video, take screenshots of every 50 frames, remove near duplicates and very light/dark images, and create a training for you.
```bash
python tune.py
```
## Fine-tuning MusicGen
With `--audio`, it’ll download just the audio, convert it to mp3 and create a training for you.
```bash
python tune.py --audio
```
## Setup
Clone this repo, and setup and activate a virtualenv:
```bash
python3 -m pip install virtualenv
python3 -m virtualenv venv
source venv/bin/activate
```
Then, install the dependencies:
`pip install -r requirements.txt`
Make a [Replicate](https://replicate.com) account and set your token:
`export REPLICATE_API_TOKEN=`
## Run it!
```bash
python tune.py
```