ADVANCED ComfyUI 2 samplers AnimateDiff v3 + AnimateLCM video to video

Опубликовано: 18 Март 2024
на канале: Koala Nation
4,959
156

In this workflow we show you the possibilities to use the TwoSamplersforMask Nodes to combine 2 different (animation) models in one render. It is used to combine background and foreground in a seamless way. We use ComfyUI with AnimateDiff v3 and AnimateLCM to create a next level comfyui video to animation (vid2vid).

👉Final workflow (Ko-fi): https://ko-fi.com/s/1876997f9a

#animatediff #comfyui #stablediffusion
============================================================
💪 Support this channel with a Super Thanks or a ko-fi! https://ko-fi.com/koalanation
☕ Amazing ComfyUI workflows: https://tinyurl.com/y9v2776r

🚨 Use Runpod and access powerful GPUs for best ComfyUI experience at a fraction of the price. https://tinyurl.com/58x2bpp5 🤗

☁️ Starting in ComfyUI? Run it on the cloud without installation, very easy! ☁️
👉 RunDiffusion: https://tinyurl.com/ypp84xjp 👉15% off first month with code 'koala15'
👉 ThinkDiffusion: https://tinyurl.com/4nh2yyen

🤑🤑🤑 FREE! Check my runnable workflows in OpenArt.ai: https://tinyurl.com/3j4z6xwf
============================================================


🔖Chapters
============================================================
00:00 Intro
01:05 Preparation: download resources, install custom nodes and models
03:51 Step 1: Load images and video in ComfyUI
05:41 Step 2: Generate background animation
09:58 Step 3: Create foreground and background masks
10:58 Step 4: Generate foreground animation (with IP Adapter)
14:51 Step 5: Prepare Ksampler providers for TwoSamplersforMask
16:45 Step 6: TwoSamplersforMask - no upscaling
17:24 Step 6: TwoSamplersforMask - with upscaling
18:55 Step 7: Facedetailer and Frame Interpolation
21:16 Rendering the complete animation with all frames
21:41 Testing the worfklow in OpenArt.ai
24:31 Outro


🧶Custom Nodes:
============================================================
Can all be installed with ComfyUI Manager (http://tinyurl.com/ms3jkk4m)
➡️ Impact Pack
➡️ ControlNet Auxiliary Preprocessors
➡️ (cubiq) IP Adapter plus
➡️ Advanced-Controlnet
➡️ AnimateDiff Evolved
➡️ VideoHelper Suite
➡️ rgthree comfyUI nodes
➡️ KJNodes for comfyUI
➡️ Crystools

👩‍🔬Checkpoints (copy in models/checkpoints)
==========================================================
➡️ Juggernaut (can be downloaded from Civit.ai)
➡️ DreamShaper (can be dowloaded from Civit.ai)

🚨 ControlNet (copy in models/controlnet folder)
==========================================================
➡️ Depth: can be downloaded from ComfyUI manager
➡️ Tile: can be downloaded from ComfyUI manager
➡️ OpenPose: can be downloaded form ComfyUI manager
➡️ ControlGIF (hugginface): http://tinyurl.com/28y9jkkr
➡️ LooseControl (civit.ai): http://tinyurl.com/2dpdnxce

🎥 AnimateLCM (https://tinyurl.com/yptwf4nt)
=========================================================
➡️ Lora: https://tinyurl.com/y4urwndf (copy in models/loras)
➡️ Motion module: https://tinyurl.com/2ch9m6j4 (copy in custom-nodes/ComfyUI-AnimateDiff-Evolved/models)

CREDITS
=========================================================
📺 Videos
Pexels

🎵Music
Song: Bike Box, Artist: Kia, Music by: CreatorMix.com
Song: Ice Cream Truck, Artist: Kia, Music by: CreatorMix.com
Song: Trinity, Artist: Kia, Music by: CreatorMix.com
Song: Doughnuts, Artist: Kia, Music by: CreatorMix.com
Song: Avatar, Artist: Kia, Music by: CreatorMix.com
Song: Spring, Artist: Kia, Music by: CreatorMix.com
Song: Deep Emotion, Artist: Soul, Music by: CreatorMix.com


✂️ Edited with Canva, and ClipChamp. I record the stuff in powerpoint.
========================================================
© 2024 Koala Nation
#comfyui #animatediff #stablediffusion


Смотрите видео ADVANCED ComfyUI 2 samplers AnimateDiff v3 + AnimateLCM video to video онлайн без регистрации, длительностью часов минут секунд в хорошем качестве. Это видео добавил пользователь Koala Nation 18 Март 2024, не забудьте поделиться им ссылкой с друзьями и знакомыми, на нашем сайте его посмотрели 4,959 раз и оно понравилось 156 людям.