ComfyUI: RAVE for video transformation (vid2 vid)
Total transformation of your videos with the new RAVE method combined with AnimateDiff. In this video, we explore the endless possibilities of RAVE (Randomized Noise Shuffling for Fast and Consistent Video Editing with Diffusion Models). We combine it with AnimateDiff to edit and convert any video into an incredible animation.
#animatediff #comfyui #stablediffusion
============================================================
💪 Support this channel with a Super Thanks or a ko-fi! https://ko-fi.com/koalanation
☕ Amazing ComfyUI workflows: https://tinyurl.com/y9v2776r
🚨 Use Runpod and access powerful GPUs for best ComfyUI experience at a fraction of the price. https://tinyurl.com/58x2bpp5 🤗
☁️ Starting in ComfyUI? Run it on the cloud without installation, very easy! ☁️
👉 RunDiffusion: https://tinyurl.com/ypp84xjp 👉15% off first month with code 'koala15'
👉 ThinkDiffusion: https://tinyurl.com/4nh2yyen
============================================================
Chapters:
00:00 Intro
00:16 RAVE and tutorial approach
01:04 Part 1 - Base workflow and installation of Custom Nodes
01:56 Part 1 - Models used in the workflow
03:02 Part 2 - RAVE workflow development and testing
05:14 Part 2 - Extending the workflow with AnimateDiff and ControlGIF
09:08 EXTRA - Second example: convert a car into a warship with LooseControl
11:06 Outro
Final workflow (in OpenArt): http://tinyurl.com/46w4achr
Base workflow (Github): http://tinyurl.com/hkfme93v
RAVE paper: https://rave-video.github.io/
Custom Nodes:
Can all be installed with ComfyUI Manager (http://tinyurl.com/ms3jkk4m)
ComfyUI-Rave
ComfyUI Noise
ComfyUI's ControlNet Auxiliary Preprocessors
ComfyUI-VideoHelper-Suite
Was Node Suite
ComfyUI-Advanced-ControlNet
AnimateDiff Evolved
rgthree's comfyUI nodes
ComfyUI Essentials
KJNodes for ComfyUI
Checkpoints (copy in models/checkpoints):
Can be downloaded from Civit.ai
Realistic Vision (can be downloaded from Civit.ai)
Juggernaut (can be downloaded from Civit.ai)
ControlNet (copy in models/controlnet folder)
Depth: can be downloaded from ComfyUI manager
ControlGIF (hugginface): http://tinyurl.com/28y9jkkr
LooseControl (civit.ai): http://tinyurl.com/2dpdnxce
AnimateDiff version 3 (http://tinyurl.com/y52cx825)
Adapter: http://tinyurl.com/3ctk78xa (copy in models/checkpoint)
Motion module: http://tinyurl.com/bdfdj8xv (copy in custom-nodes/ComfyUI-AnimateDiff-Evolved/models)
Videos
Pexels: http://tinyurl.com/46m8zxpk
Pixabay: http://tinyurl.com/yc46w8fh
Music
Song: It's Our Time
Music by: CreatorMix.com
Edited with Canva, and ClipChamp. I record the stuff in powerpoint.
© 2024 Koala Nation
#comfyui #animatediff #stablediffusion
Watch video ComfyUI: RAVE for video transformation (vid2 vid) online without registration, duration hours minute second in high quality. This video was added by user Koala Nation 19 January 2024, don't forget to share it with your friends and acquaintances, it has been viewed on our site 6,891 once and liked it 269 people.