ComfyUI: RAVE for video transformation (vid2 vid)

Опубликовано: 19 Январь 2024
на канале: Koala Nation
6,891
269

Total transformation of your videos with the new RAVE method combined with AnimateDiff. In this video, we explore the endless possibilities of RAVE (Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Models). We combine it with AnimateDiff to edit and convert any video into an incredible animation.
#animatediff #comfyui #stablediffusion
============================================================
💪 Support this channel with a Super Thanks or a ko-fi! https://ko-fi.com/koalanation
☕ Amazing ComfyUI workflows: https://tinyurl.com/y9v2776r

🚨 Use Runpod and access powerful GPUs for best ComfyUI experience at a fraction of the price. https://tinyurl.com/58x2bpp5 🤗

☁️ Starting in ComfyUI? Run it on the cloud without installation, very easy! ☁️
👉 RunDiffusion: https://tinyurl.com/ypp84xjp 👉15% off first month with code 'koala15'
👉 ThinkDiffusion: https://tinyurl.com/4nh2yyen

============================================================

Chapters:
00:00 Intro
00:16 RAVE and tutorial approach
01:04 Part 1 - Base workflow and installation of Custom Nodes
01:56 Part 1 - Models used in the workflow
03:02 Part 2 - RAVE workflow development and testing
05:14 Part 2 - Extending the workflow with AnimateDiff and ControlGIF
09:08 EXTRA - Second example: convert a car into a warship with LooseControl
11:06 Outro

Final workflow (in OpenArt): http://tinyurl.com/46w4achr
Base workflow (Github): http://tinyurl.com/hkfme93v

RAVE paper: https://rave-video.github.io/

Custom Nodes:
Can all be installed with ComfyUI Manager (http://tinyurl.com/ms3jkk4m)
ComfyUI-Rave
ComfyUI Noise
ComfyUI's ControlNet Auxiliary Preprocessors
ComfyUI-VideoHelper-Suite
Was Node Suite
ComfyUI-Advanced-ControlNet
AnimateDiff Evolved
rgthree's comfyUI nodes
ComfyUI Essentials
KJNodes for ComfyUI

Checkpoints (copy in models/checkpoints):
Can be downloaded from Civit.ai
Realistic Vision (can be downloaded from Civit.ai)
Juggernaut (can be downloaded from Civit.ai)

ControlNet (copy in models/controlnet folder)
Depth: can be downloaded from ComfyUI manager
ControlGIF (hugginface): http://tinyurl.com/28y9jkkr
LooseControl (civit.ai): http://tinyurl.com/2dpdnxce

AnimateDiff version 3 (http://tinyurl.com/y52cx825)
Adapter: http://tinyurl.com/3ctk78xa (copy in models/checkpoint)
Motion module: http://tinyurl.com/bdfdj8xv (copy in custom-nodes/ComfyUI-AnimateDiff-Evolved/models)


Videos
Pexels: http://tinyurl.com/46m8zxpk
Pixabay: http://tinyurl.com/yc46w8fh

Music
Song: It's Our Time
Music by: CreatorMix.com

Edited with Canva, and ClipChamp. I record the stuff in powerpoint.

© 2024 Koala Nation
#comfyui #animatediff #stablediffusion


Смотрите видео ComfyUI: RAVE for video transformation (vid2 vid) онлайн без регистрации, длительностью часов минут секунд в хорошем качестве. Это видео добавил пользователь Koala Nation 19 Январь 2024, не забудьте поделиться им ссылкой с друзьями и знакомыми, на нашем сайте его посмотрели 6,891 раз и оно понравилось 269 людям.