• Stars
    star
    172
  • Rank 221,201 (Top 5 %)
  • Language
    Python
  • Created about 1 year ago
  • Updated 3 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Fine tune SDXL on YouTube videos

YouTune

DALL·E 2023-10-26 19 39 10 - Photo of a sophisticated logo for 'YouTune'  The design emphasizes the theme of tuning videos  It incorporates a stylized film reel that intertwines w

YouTune Video Walkthrough

YouTune makes it really easy to:

  • fine-tune SDXL on images from YouTube videos
  • fine-tune MusicGen on audio from YouTube videos

Fine-tuning SDXL

Just give it a URL and a model name on Replicate, and it’ll download the video, take screenshots of every 50 frames, remove near duplicates and very light/dark images, and create a training for you.

python tune.py <youtube-url>

Fine-tuning MusicGen

With --audio, it’ll download just the audio, convert it to mp3 and create a training for you.

python tune.py <youtube-url> --audio

Setup

Clone this repo, and setup and activate a virtualenv:

python3 -m pip install virtualenv
python3 -m virtualenv venv
source venv/bin/activate

Then, install the dependencies: pip install -r requirements.txt

Make a Replicate account and set your token:

export REPLICATE_API_TOKEN=<token>

Run it!

python tune.py <youtube-url>