Live AR Theater Sizzle

Published: 16 July 2019
on channel: Robert Lester
691
5

In spring of 2019, I was tasked by NYC's Technodramatists with designing and creating a wireless, interactive AR system to allow a roving actor to perform a one-woman show with live facial motion capture and 3D animation to tell the story of Shakespeare’s Comedy of Errors. This is a selection of live clips from the performance.

For a more in-depth breakdown check out:    • Live Facial Animation with Unreal Eng...  

The system was driven by Epic Game’s Unreal Engine, and built/hacked on top of the official Face AR Sample template, which does a lot of the heavy lifting connecting Apple’s ARkit face tracking to Unreal Engine blueprints. I did custom blueprint code specific for each mask to help amplify some facial animation parameters to help achieve the intended performance effects. Many thanks to the people at Epic whose work went into this core functionality before I adopted it to build some other stuff on top of.

Actor: Claire Tyers
Director: Noa Egozi
Executive Producer: Lorne Svarc

Tools used:
Epic Unreal Engine 4
Maya
Cinema4D
RizomUV
Turbosquid
Polywink

For more info:
robertlestercreative.com
technodramatists.com

TW @robertluxtweets
IG @robertluxmadethis


Watch video Live AR Theater Sizzle online without registration, duration hours minute second in high quality. This video was added by user Robert Lester 16 July 2019, don't forget to share it with your friends and acquaintances, it has been viewed on our site 691 once and liked it 5 people.