COMFYUI Morphing workflow: the beginnings.
Face Morphing Effect Animation using Stable Diffusion
This ComfyUI workflow is a combination of AnimateDiff, ControlNet, IP Adapter, masking and Frame Interpolation. To be able to use SDXL models, the workflow needs to use the HotShotXL motion module. The workflow is partly based in the HotShot XL method by Inner Reflections.
#animatediff #comfyui #stablediffusion
============================================================
💪 Support this channel with a Super Thanks or a ko-fi! https://ko-fi.com/koalanation
☕ Amazing ComfyUI workflows: https://tinyurl.com/y9v2776r
🚨 Use Runpod and access powerful GPUs for best ComfyUI experience at a fraction of the price. https://tinyurl.com/58x2bpp5 🤗
☁️ Starting in ComfyUI? Run it on the cloud without installation, very easy! ☁️
👉 RunDiffusion: https://tinyurl.com/ypp84xjp 👉15% off first month with code 'koala15'
👉 ThinkDiffusion: https://tinyurl.com/4nh2yyen
===========================================================
The final workflow:
http://tinyurl.com/mr2vxjwy
HotShotXL: http://tinyurl.com/48t4r9r4 (I use the fp16 version)
For the rest of the models, the easiest is to use ComfyUI Manager:
SDXL VAE
SDXL BASE (checkpoint)
OpenPoseXL2 (SDXL ControlNet)
ControlNet Depth SDXL 1.0
ClipVision SD1.5 (for IP adapter)
IP Adapter plus SDXL VIT-H
Tracklist:
00:00 Intro
00:10 Assets for the tutorial (Civit.AI)
01:32 Workflow and ComfyUI Manager Install custom Nodes
01:48 Workflow Overview
03:02 Bypassing nodes to start demo
03:17 Inputs and Models (incl. AnimateDiff)
04:13 Prompt and ControlNets
05:00 Testing the AnimateDiff workflow (HotShotXL) without masks and morphing
05:31 Activating IP Adapter with 1 reference image
06:30 Test with IP Adapter (no masking and morphing)
06:47 Activating the face mask
08:58 Results when the face mask is applied (consistent background)
09:07 Morphing effect (Frame Interpolation)
09:44 Short Test quick morphing effect
09:54 Complete Morphing Effect and complete Animation render
10:25 Final results - Animation Face Morphing
10:46 Upscale Video activation and comparison Face Morphing animation with original video
11:07 Outro
My other tutorials:
AnimadeDiff + LCM high Definition: • LCM + AnimateDiff High Definition (Co...
Animatediff + ControlNet + conditional masking.i: • Animatediff perfect scenes. Any backg...
AnimateDiff and Instant Lora: • ComfyUI Instant Lora Animatediff ulti...
ComfyUI animation tutorial: • Stable Diffusion ComfyUI Animations ...
Vast.ai: • ComfyUI - Vast.ai: tutorial - how to ...
TrackAnything: • ComfyUI animation with segmentation: ...
Make sure to subscribe to Koala Nation Channel:
https://cutt.ly/OZF0UhT
Videos: Pexels
Music: Youtube Music Library
Edited with Canva, and ClipChamp. I record the stuff in powerpoint.
© 2023 Koala Nation
#comfyui #animatediff #stablediffusion #lcm
Watch video COMFYUI Morphing workflow: the beginnings. online without registration, duration hours minute second in high quality. This video was added by user Koala Nation 12 December 2023, don't forget to share it with your friends and acquaintances, it has been viewed on our site 3,225 once and liked it 81 people.