CLIP music video
Code for making music videos using CLIP
How to run (using biggan)
python3 main.py --epochs 400 --textfile yannic_lyrics.txt --audiofile Weasle_sample_audio.mp3use less epochs to trade off quality and speed.
References
https://towardsdatascience.com/generating-images-from-prompts-using-clip-and-stylegan-1f9ed495ddda
https://arxiv.org/pdf/2102.01645v2.pdf
https://colab.research.google.com/drive/1FoHdqoqKntliaQKnMoNs3yn5EALqWtvP?usp=sharing
https://colab.research.google.com/drive/1NCceX2mbiKOSlAd_o7IU7nA9UskKN5WR?usp=sharing
https://twitter.com/jonathanfly/status/1362396180978798593
https://github.com/orpatashnik/StyleCLIP
https://twitter.com/Miles_Brundage/status/1363268217385349121
https://twitter.com/jonathanfly/status/1363550050899554311
https://colab.research.google.com/drive/1Q-TbYvASMPRMXCOQjkxxf72CXYjR_8Vp?usp=sharing
https://gist.github.com/l4rz/7040835c3f8266d8b8ea3615a0b49494
https://twitter.com/eps696/status/1363419772252278791
install ImageMagick for Moviepy textclips
instructions here
https://techpiezo.com/linux/install-imagemagick-in-ubuntu-20-04-lts/ To edit permission follow this steps:
file /etc/ImageMagick/policy.xml here,
changed <policy domain="path" rights="none" pattern="@*" />
to <policy domain="path" rights="read,write" pattern="@*" />BigGan_Dall-E_Clip with moviepy
Please create a folder 'output' for the generated images to be saved in. Please install clip and dall-e
pip install git+https://github.com/openai/CLIP.git
pip install DALL-Ethe dall-e decoder is here:
https://cdn.openai.com/dall-e/decoder.pkl