A python script to convert music lyric files into stable diffusion prompts
You can run this project on colab. It uses gradio ui and needs no installation on your local machine
pip install -r requirements.txt
python cmusic_gradio.py
python cmusic.py
Follow prompts in cli to download lyric for your music and convert it into stable diffusion prompts
Put your files in files directory with following names:
- input.mp4
- input.mp3
- lyric.json
Run this script to merge them into one clip, You will need to install and configure ImageMagick library first.
python lyric_on_video.py
The file will be generated at:
- output.mp4
- Python 3
- Deforum extension with automatic1111 web ui
You can add other music website databases. It is done by defining your custom adapter in adapters folder and implementing adapters.url_adapter interface.
Then add your new adapter class to adapters list initialzed at the begining of cmusic and cmusic_gradio python files.