Stable Diffusion audio-reactive ANIMATION driven by Spitfire pianos [Music Video]

Опубликовано: 25 Март 2023
на канале: Jakub Ciupinski
1,191
86

Music tools used in this clip: Bitwig Studio, Spitfire Cinematic Soft Piano, Spitfire Felt Piano, Spitfire Olafur Arnalds Composer Toolkit, Spitfire Olafur Arnalds Stratus, Spitfire Albion Neo, Soundiron Rumba Boxes Hopkins Instrumentarium, NI Una Corda Felt piano, Pianoteq 7, Pro-Q 3, Pro-L 2, Valhalla Room, Gullfoss, PSP Vintage Warmer.

Visuals:
Adobe Premiere Pro

Deforum Stable Diffusion colab v0.7:
https://colab.research.google.com/git...

For this video, I used approximately 80 compute units on NVIDIA A100-SXM4-40GB with v2-1_768-ema-pruned.ckpt checkpoint. I set my composition to 112.50 BPM so the sixteenth notes would match every 4th frame of the 30fps video (diffusion_cadence = 4). Then I wrote my custom strength/noise schedule to match the music.

…and btw, my new album ‘Heroides’, with the renowned opera singer Małgorzata Walewska, is now out:

Tidal: https://tidal.com/browse/album/268218863
Spotify: https://open.spotify.com/album/21tgKd...
Apple Music:   / heroides  


Смотрите видео Stable Diffusion audio-reactive ANIMATION driven by Spitfire pianos [Music Video] онлайн без регистрации, длительностью часов минут секунд в хорошем качестве. Это видео добавил пользователь Jakub Ciupinski 25 Март 2023, не забудьте поделиться им ссылкой с друзьями и знакомыми, на нашем сайте его посмотрели 1,19 раз и оно понравилось 8 людям.