Live Facial Animation with Unreal Engine and Apple ARKit

Опубликовано: 16 Июль 2019
на канале: Robert Lester
6,715
107

This is a case-study breakdown for a recent project I did in collaboration with NYC’s Technodramatists. I was tasked with designing and creating a wireless, interactive AR system to allow a roving actor to perform a one-woman show with live facial motion capture and 3D animation to tell the story of Shakespeare’s Comedy of Errors.

The system was driven by Epic Game’s Unreal Engine, and built/hacked on top of the official Face AR Sample template, which does a lot of the heavy lifting connecting Apple’s ARkit face tracking to Unreal Engine blueprints. I did custom blueprint code specific for each mask to help amplify some facial animation parameters to help achieve the intended performance effects. Many thanks to the people at Epic whose work went into this core funcationality before I adopted it to build some other stuff on top of.

For the full case study, check out:
https://www.robertlestercreative.com/...
For more live clips from the show check out:
   • Live AR Theater Sizzle  

Tools used:
Epic Unreal Engine 4
Maya
Cinema4D
RizomUV
Turbosquid
Polywink

For more info:
robertlestercreative.com
technodramatists.com


Смотрите видео Live Facial Animation with Unreal Engine and Apple ARKit онлайн без регистрации, длительностью часов минут секунд в хорошем качестве. Это видео добавил пользователь Robert Lester 16 Июль 2019, не забудьте поделиться им ссылкой с друзьями и знакомыми, на нашем сайте его посмотрели 6,715 раз и оно понравилось 107 людям.