An Interactive Approach for Functional Prototype Recovery from a Single RGBD Image

Published: 14 April 2024
on channel: Yin Yang
0

An Interactive Approach for Functional Prototype Recovery from a Single RGBD Image
Yuliang Rong, Tianjia Shao, Youyi Zheng, Yin Yang, Kun Zhou
Computational Visual Media, 2016
====================
Inferring the functionality of an object from a single RGBD image is difficult for two reasons: lack of semantic information about the object, and missing data due to occlusion. In this paper, we present an interactive framework to recover a 3D functional prototype from a single RGBD image. Instead of precisely reconstructing the object geometry for the prototype, we mainly focus on recovering the object’s functionality along with its geometry. Our system allows users to scribble on the image to create initial rough proxies for the parts. After user annotation of high-level relations between parts, our system automatically jointly optimizes detailed joint parameters (axis and position) and part geometry parameters (size, orientation, and position). Such prototype recovery enables a better understanding of the underlying image geometry and allows for further physically plausible manipulation. We demonstrate our framework on various indoor objects with simple or hybrid functions.


Watch video An Interactive Approach for Functional Prototype Recovery from a Single RGBD Image online without registration, duration hours minute second in high quality. This video was added by user Yin Yang 14 April 2024, don't forget to share it with your friends and acquaintances, it has been viewed on our site once and liked it 0 people.