ComfyUI Instant Lora Animatediff ultimate method for video to video

Опубликовано: 24 Октябрь 2023
на канале: Koala Nation
37,522
841

Combine AnimateDiff and the Instant Lora method for stunning results in ComfyUI. Easy to learn and try.

#animatediff #comfyui #stablediffusion
============================================================
💪 Support this channel with a Super Thanks or a ko-fi! https://ko-fi.com/koalanation
☕ Amazing ComfyUI workflows: https://tinyurl.com/y9v2776r

🚨 Use Runpod and access powerful GPUs for best ComfyUI experience at a fraction of the price. https://tinyurl.com/58x2bpp5 🤗

☁️ Starting in ComfyUI? Run it on the cloud without installation, very easy! ☁️
👉 RunDiffusion: https://tinyurl.com/ypp84xjp 👉15% off first month with code 'koala15'
👉 ThinkDiffusion: https://tinyurl.com/4nh2yyen

🤑🤑🤑 FREE! Check my runnable workflows in OpenArt.ai: https://tinyurl.com/2twcmvya
============================================================



In this video I will show you how to install all the nodes and models required for AnimateDiff and the Instant Lora method with IP Adapters, in ComfyUI. Below the complete list of requirements.

In the video you will learn how to use the method with a simple example. With the addition of ControlNet, this method is AMAZING! Use you creativity to make something amazing!

Please, support this channel with a ko-fi!
https://ko-fi.com/koalanation

Run Comfyui with:
RXT 3090 24GB: https://tinyurl.com/27x45jy4

This video is inspired by many videos being recommended about AnimateDiff and Instant Lora. However, I was not able to find a video which combines these two approaches, so I decided to make this one. However, the recognition should go to the original creators of the separated methods:

AnimateDiff (original): https://tinyurl.com/4hfvv34r
AnimateDiff Evolved: https://tinyurl.com/yrwz576p
Aloe Vera's Instant Lora method (no training): https://tinyurl.com/yc4wmstr

Workflow for this video: https://tinyurl.com/3terxszu

Basic requirements:
ComfyUI: https://tinyurl.com/24srsvb3
ComfyUI Manager: https://tinyurl.com/ycvm4e29
Vast.ai: https://tinyurl.com/5n972ran
WAS node Suite: https://tinyurl.com/2ajuh2mx

OpenPose frames:https://tinyurl.com/y23cfnk4
Girl Exercising: https://tinyurl.com/3dsrkzy9
GeminiX Mix (civit.ai): https://tinyurl.com/2ssudwhf
GeminiX Mix (huggingface): https://tinyurl.com/nfxphz48
ControlNet v1.1: https://tinyurl.com/je85785u

Aloe Vera's Instant Lora (no training) requirements
Method: https://tinyurl.com/yc4wmstr
IP Adapter: https://tinyurl.com/3x3f2rfw
ComfyUI Impact pack: https://tinyurl.com/4jsmf8va
ComfyUI Inspire pack: https://tinyurl.com/2wkzezxm
IP Adapter bin model: https://tinyurl.com/2p8ykxf6
IP Adapter clipvision encoder: https://tinyurl.com/2wrtvnx4

AnimateDiff (Evolved)
AnimateDiff Evolved: https://tinyurl.com/yrwz576p
Advanced ControlNet custom node: https://tinyurl.com/yc3szuuf
VideoHelper Suite: https://tinyurl.com/47hka2nn
ControlNet Auxiliary preprocessors: https://tinyurl.com/3j3p6bjw
AnimateDiff models (mm and mloras): https://tinyurl.com/mw6jwzpk
AnimateDiff stabilized models: https://tinyurl.com/mr42m5hp
AnimateDiff finetune models: https://tinyurl.com/mud8cr69
AnimateDiff temporalDiff: https://tinyurl.com/yc8tnnas

Tracklist:
00:00 Intro
00:11 Requirements (basic, Instant Lora and AnimateDiff)
00:33 AnimateDiff and Instant Lora [ no training] methods
00:50 Base images and models
01:31 Installation of Custom Nodes needed (via Manager)
02:52 Installation of models for AnimateDiff and Instant Lora (IP Adapter) and ControlNet (OpenPose)
04:07 Using AnimateDiff + OpenPose template in your workflow
04:34 AnimateDiff workflow setup and testing
06:54 Implementing the Instant Lora method [no training] with IP Adapters in the AnimateDiff workflow
08:33 Adding FaceDetailer to improve the face resolution
09:57 Running all the frames/poses of the ComfyUI workflow
10:27 The final result
10:47 Outro


My other tutorials:
ComfyUI animation tutorial:    • Stable Diffusion ComfyUI Animations  ...  
Vast.ai:    • ComfyUI - Vast.ai: tutorial - how to ...  
TrackAnything:    • ComfyUI animation with segmentation: ...  

Videos: Pexels
Music: Youtube Music Library
Edited with Canva, Runway.ml and ClipChamp

Subscribe to Koala Nation Channel: https://cutt.ly/OZF0UhT

© 2023 Koala Nation
#comfyui #animatediff #sd


Смотрите видео ComfyUI Instant Lora Animatediff ultimate method for video to video онлайн без регистрации, длительностью часов минут секунд в хорошем качестве. Это видео добавил пользователь Koala Nation 24 Октябрь 2023, не забудьте поделиться им ссылкой с друзьями и знакомыми, на нашем сайте его посмотрели 37,522 раз и оно понравилось 841 людям.