Scalable Image-based Indoor Scene Rendering with Reflections
Scalable Image-based Indoor Scene Rendering with Reflections
Jiamin Xu, Xiuchao Wu, Zihan Zhu, Weiwei Xu, Yin Yang, Hujun Bao, Qixing Huang
ACM Transactions on Graphics (SIGGRAPH), 2021
====================
This paper proposes a novel scalable image-based rendering (IBR) pipeline for indoor scenes with reflections. We make substantial progress towards three sub-problems in IBR, namely, depth and reflection reconstruction, view selection for temporally coherent view-warping, and smooth rendering refinements. First, we introduce a global-mesh-guided alternating optimization algorithm that robustly extracts a two-layer geometric representation. The front and back layers encode the RGB-D reconstruction and the reflection reconstruction, respectively. This representation minimizes the image composition error under novel views, enabling accurate renderings of reflections. Second, we introduce a novel approach to select adjacent views and compute blending weights for smooth and temporal coherent renderings. The third contribution is a supersampling network with a motion vector rectification module that refines the rendering results to improve the final output's temporal coherence. These three contributions together lead to a novel system that produces highly realistic rendering results with various reflections. The rendering quality outperforms state-of-the-art IBR or neural rendering algorithms considerably.
Смотрите видео Scalable Image-based Indoor Scene Rendering with Reflections онлайн без регистрации, длительностью часов минут секунд в хорошем качестве. Это видео добавил пользователь Yin Yang 14 Апрель 2024, не забудьте поделиться им ссылкой с друзьями и знакомыми, на нашем сайте его посмотрели 5 раз и оно понравилось 0 людям.