Using AI technique - DAIN
Using AI to smooth my footage 😌 with James Perlman. This tech is pretty obscure now, but I do think it will be mainstream within the next year or two.
It's called DAIN, which is an AI technique that smoothly interpolates frames. For every frame you see, it generates 8 frames in between with incredibly smoothness and accuracy. Its main use case is to create artificial (and very convincing) slow motion on clips, but I thought it'd be interesting to apply it to stop motion to create "impossible" movements.
You can try DAIN by visiting https://grisk.itch.io/dain-app.
It works on Windows and NVIDIA only (it requires a TON of GPU power) and isn't the easiest to set up or run. But I do believe that this technology will become more mainstream and it won't be too long before people can download an iPhone or Android app, press a button, and apply this effect.
Keep in mind though that with this clip, and with most things I share on this page (especially AI-related) there's massive selection bias - I'm cherry-picking the best examples to show you. We tested over 100 clips and these were my favorite results. There's a lot of motions and movements that didn't do well - for example anything where I rotated my body or had overlapping movements.
Director @karenxcheng
Editor James Perlman
DAIN-App by Gabriel Poetsch
Credits to the incredible AI researchers who created DAIN: Wenbo Bao, Wei-Sheng Lai, Chao Ma, Xiaoyun Zhang, Zhiyong Gao, Ming-Hsuan Yang
See their research here: https://arxiv.org/abs/1904.00830
Follow me on IG for more videos
IG: / karenxcheng
WHO AM I
Hey, I'm Karen X Cheng.
I’m a creative director and I love sharing my creative ideas and experiments!
#stopmotion #artificialintelligence
Watch video Using AI technique - DAIN online without registration, duration hours minute second in high quality. This video was added by user karenxcheng 27 July 2022, don't forget to share it with your friends and acquaintances, it has been viewed on our site 275,837 once and liked it 9.5 thousand people.