ADVANCED ComfyUI 2 samplers AnimateDiff v3 + AnimateLCM video to video

Published: 18 March 2024
on channel: Koala Nation
4,959
156

In this workflow we show you the possibilities to use the TwoSamplersforMask Nodes to combine 2 different (animation) models in one render. It is used to combine background and foreground in a seamless way. We use ComfyUI with AnimateDiff v3 and AnimateLCM to create a next level comfyui video to animation (vid2vid).

👉Final workflow (Ko-fi): https://ko-fi.com/s/1876997f9a

#animatediff #comfyui #stablediffusion
============================================================
💪 Support this channel with a Super Thanks or a ko-fi! https://ko-fi.com/koalanation
☕ Amazing ComfyUI workflows: https://tinyurl.com/y9v2776r

🚨 Use Runpod and access powerful GPUs for best ComfyUI experience at a fraction of the price. https://tinyurl.com/58x2bpp5 🤗

☁️ Starting in ComfyUI? Run it on the cloud without installation, very easy! ☁️
👉 RunDiffusion: https://tinyurl.com/ypp84xjp 👉15% off first month with code 'koala15'
👉 ThinkDiffusion: https://tinyurl.com/4nh2yyen

🤑🤑🤑 FREE! Check my runnable workflows in OpenArt.ai: https://tinyurl.com/3j4z6xwf
============================================================


🔖Chapters
============================================================
00:00 Intro
01:05 Preparation: download resources, install custom nodes and models
03:51 Step 1: Load images and video in ComfyUI
05:41 Step 2: Generate background animation
09:58 Step 3: Create foreground and background masks
10:58 Step 4: Generate foreground animation (with IP Adapter)
14:51 Step 5: Prepare Ksampler providers for TwoSamplersforMask
16:45 Step 6: TwoSamplersforMask - no upscaling
17:24 Step 6: TwoSamplersforMask - with upscaling
18:55 Step 7: Facedetailer and Frame Interpolation
21:16 Rendering the complete animation with all frames
21:41 Testing the worfklow in OpenArt.ai
24:31 Outro


🧶Custom Nodes:
============================================================
Can all be installed with ComfyUI Manager (http://tinyurl.com/ms3jkk4m)
➡️ Impact Pack
➡️ ControlNet Auxiliary Preprocessors
➡️ (cubiq) IP Adapter plus
➡️ Advanced-Controlnet
➡️ AnimateDiff Evolved
➡️ VideoHelper Suite
➡️ rgthree comfyUI nodes
➡️ KJNodes for comfyUI
➡️ Crystools

👩‍🔬Checkpoints (copy in models/checkpoints)
==========================================================
➡️ Juggernaut (can be downloaded from Civit.ai)
➡️ DreamShaper (can be dowloaded from Civit.ai)

🚨 ControlNet (copy in models/controlnet folder)
==========================================================
➡️ Depth: can be downloaded from ComfyUI manager
➡️ Tile: can be downloaded from ComfyUI manager
➡️ OpenPose: can be downloaded form ComfyUI manager
➡️ ControlGIF (hugginface): http://tinyurl.com/28y9jkkr
➡️ LooseControl (civit.ai): http://tinyurl.com/2dpdnxce

🎥 AnimateLCM (https://tinyurl.com/yptwf4nt)
=========================================================
➡️ Lora: https://tinyurl.com/y4urwndf (copy in models/loras)
➡️ Motion module: https://tinyurl.com/2ch9m6j4 (copy in custom-nodes/ComfyUI-AnimateDiff-Evolved/models)

CREDITS
=========================================================
📺 Videos
Pexels

🎵Music
Song: Bike Box, Artist: Kia, Music by: CreatorMix.com
Song: Ice Cream Truck, Artist: Kia, Music by: CreatorMix.com
Song: Trinity, Artist: Kia, Music by: CreatorMix.com
Song: Doughnuts, Artist: Kia, Music by: CreatorMix.com
Song: Avatar, Artist: Kia, Music by: CreatorMix.com
Song: Spring, Artist: Kia, Music by: CreatorMix.com
Song: Deep Emotion, Artist: Soul, Music by: CreatorMix.com


✂️ Edited with Canva, and ClipChamp. I record the stuff in powerpoint.
========================================================
© 2024 Koala Nation
#comfyui #animatediff #stablediffusion


Watch video ADVANCED ComfyUI 2 samplers AnimateDiff v3 + AnimateLCM video to video online without registration, duration hours minute second in high quality. This video was added by user Koala Nation 18 March 2024, don't forget to share it with your friends and acquaintances, it has been viewed on our site 4,959 once and liked it 156 people.