Using AI technique - DAIN

Опубликовано: 27 Июль 2022
на канале: karenxcheng
275,837
9.5k

Using AI to smooth my footage 😌 with James Perlman. This tech is pretty obscure now, but I do think it will be mainstream within the next year or two.

It's called DAIN, which is an AI technique that smoothly interpolates frames. For every frame you see, it generates 8 frames in between with incredibly smoothness and accuracy. Its main use case is to create artificial (and very convincing) slow motion on clips, but I thought it'd be interesting to apply it to stop motion to create "impossible" movements.

You can try DAIN by visiting https://grisk.itch.io/dain-app.
It works on Windows and NVIDIA only (it requires a TON of GPU power) and isn't the easiest to set up or run. But I do believe that this technology will become more mainstream and it won't be too long before people can download an iPhone or Android app, press a button, and apply this effect.

Keep in mind though that with this clip, and with most things I share on this page (especially AI-related) there's massive selection bias - I'm cherry-picking the best examples to show you. We tested over 100 clips and these were my favorite results. There's a lot of motions and movements that didn't do well - for example anything where I rotated my body or had overlapping movements.

Director @karenxcheng
Editor James Perlman
DAIN-App by Gabriel Poetsch

Credits to the incredible AI researchers who created DAIN: Wenbo Bao, Wei-Sheng Lai, Chao Ma, Xiaoyun Zhang, Zhiyong Gao, Ming-Hsuan Yang
See their research here: https://arxiv.org/abs/1904.00830

Follow me on IG for more videos
IG:   / karenxcheng  

WHO AM I
Hey, I'm Karen X Cheng.
I’m a creative director and I love sharing my creative ideas and experiments!

#stopmotion #artificialintelligence


Смотрите видео Using AI technique - DAIN онлайн без регистрации, длительностью часов минут секунд в хорошем качестве. Это видео добавил пользователь karenxcheng 27 Июль 2022, не забудьте поделиться им ссылкой с друзьями и знакомыми, на нашем сайте его посмотрели 275,837 раз и оно понравилось 9.5 тысяч людям.