Animatediff perfect scenes. Any background with conditional masking. ComfyUI Animation
Consistent animations with perfect blending of foreground and background in ComfyUI and AnimateDiff. Do you want to know how?
Discord: / discord
#animatediff #comfyui #stablediffusion
============================================================
💪 Support this channel with a Super Thanks or a ko-fi! https://ko-fi.com/koalanation
☕ Amazing ComfyUI workflows: https://tinyurl.com/y9v2776r
🚨 Use Runpod and access powerful GPUs for best ComfyUI experience at a fraction of the price. https://tinyurl.com/58x2bpp5 🤗
☁️ Starting in ComfyUI? Run it on the cloud without installation, very easy! ☁️
👉 RunDiffusion: https://tinyurl.com/ypp84xjp 👉15% off first month with code 'koala15'
👉 ThinkDiffusion: https://tinyurl.com/4nh2yyen
============================================================
This method explores the blending of a foreground character with any background you want to use avoiding the edges which occur when masking frames. This is done with masking BEFORE rendering the images, and using conditional masking to control the rendering of foreground and background, using ControlNet.
Please, support this channel with a ko-fi!
https://ko-fi.com/koalanation
The workflow and frames to test this workflow are found in this Civit.AI article: https://tinyurl.com/w2xr3hj4
The tutorial where I show the basic workflow using the InstantLora method + AnimateDiff:
• ComfyUI Instant Lora Animatediff ulti...
Basic requirements:
ComfyUI: https://tinyurl.com/24srsvb3
ComfyUI Manager: https://tinyurl.com/ycvm4e29
Vast.ai: https://tinyurl.com/5n972ran
Runpod: https://tinyurl.com/mvbh46hk
Custom nodes:
AnimateDiff Evolved: https://tinyurl.com/yrwz576p
Advanced ControlNet custom node: https://tinyurl.com/yc3szuuf
VideoHelper Suite: https://tinyurl.com/47hka2nn
ControlNet Auxiliary preprocessors: https://tinyurl.com/3j3p6bjw
IP Adapter: https://tinyurl.com/3x3f2rfw
ComfyUI Impact pack: https://tinyurl.com/4jsmf8va
ComfyUI Inspire pack: https://tinyurl.com/2wkzezxm
KJ Nodes: https://github.com/kijai/ComfyUI-KJNodes
WAS node Suite: https://tinyurl.com/2ajuh2mx
Models:
DreamShaper v8 (SD1.5): https://tinyurl.com/3rka67pa
ControlNet v1.1: https://tinyurl.com/je85785u
vae-ft-mse-840000-ema-pruned VAE: https://tinyurl.com/c9t6wntc
ClipVision model for IP-Adapter: https://tinyurl.com/2wrtvnx4
IP Adapter plus SD1.5: https://tinyurl.com/2p8ykxf6
Motion Lora mm-stabilized-mid: https://tinyurl.com/mr42m5hp
Upscale RealESRGANx2: https://tinyurl.com/2frvcyca
Tracklist:
00:00 Intro
00:13 Method: approach and explanation
00:32 Basic requirements
00:41 Downloading and copy of assets from Civit AI
01:16 Base AnimateDiff and Instant Lora: installing missing custom nodes and updating ComfyUI with Manager
01:59 Models used in the workflow
02:17 Testing the basic workflow
02:40 Creating Lora reference image with a new different background
workflow test
05:13 ControlNet for the background
06:10 Creating masks for the foreground (hero) and background
07:38 Conditional masking (blending masks and controlnets of foreground + background)
09:34 Running the workflow for all frames to create your full animation - including face detailing and frame interpolation
10:18 Outro
My other tutorials:
AnimateDiff and Instant Lora: • ComfyUI Instant Lora Animatediff ulti...
ComfyUI animation tutorial: • Stable Diffusion ComfyUI Animations ...
Vast.ai: • ComfyUI - Vast.ai: tutorial - how to ...
TrackAnything: • ComfyUI animation with segmentation: ...
Videos: Pexels
Music: Youtube Music Library
Edited with Canva, Runway.ml and ClipChamp
Subscribe to Koala Nation Channel: https://cutt.ly/OZF0UhT
© 2023 Koala Nation
#comfyui #animatediff #stablediffusion
Watch video Animatediff perfect scenes. Any background with conditional masking. ComfyUI Animation online without registration, duration hours minute second in high quality. This video was added by user Koala Nation 21 November 2023, don't forget to share it with your friends and acquaintances, it has been viewed on our site 10,561 once and liked it 347 people.