Markerless AI Mocap to in-game Metahuman
In previous updates I was experimenting with connecting Metahumans to pre-recorded library mocap data in Fortnite - the next obvious thing to do is to hook the Metahuman up to my own custom mocap data.
But since I don't own a mocap suit, I wanted to check out AI powered mocap tools, without the need for any other hardware but a camera. I tried a couple, but found that Move.ai supplied the most stable output, considering I captured with only one camera.
Who else to test this setup with, but my son Daan - as a huge Fortnite fan he asked if he could perform his personal emote.🙂
Below is a screencapture of Daan's footage - Move AI's interpretation - and the mocap data connected to a realtime Metahuman in Fortnite.
Considering that Move.ai also supports multiple camera's for more stable results, I think AI mocap is definately here to stay to support amazing realtime content creation. I even found it to be more accurate than marker-based suits.
What do you think?
Watch video Markerless AI Mocap to in-game Metahuman online without registration, duration hours minute second in high quality. This video was added by user Aron Versteeg 13 May 2024, don't forget to share it with your friends and acquaintances, it has been viewed on our site 5 once and liked it people.