We use cookies to improve your experience with our site.

生成式三维重建近期研究进展综述

A Survey of Recent Advances in Generative 3D Reconstruction

  • 摘要: 随着生成式AI模型方法的迅速发展,三维重建方面也取得了巨大的进展,这些进展将传统的三维重建方法框架从神经隐式三维重建推进为生成式三维重建,尤其在生成式AI模型加持下,在更稳定和更易用的三维重建系统和效果上取得进展。然而,三维重建方面目前尚缺少全面分析和总结的综述文章。为此,本文对当前生成式三维重建最新进展进行全面分析、总结,特别是计算机图形学和计算机视觉两个领域中关于生成式三维重建的最新研究工作和成果。首先,本文将现有的生成式三维重建工作进展分为四类:生成式sfM/MVS、基于GAN的三维重建、基于扩散模型的三维重建和跨模态三维重建。此外,本文还对生成式三维重建的一些应用工作,包括动态数字人、三维交互式编辑和自动驾驶等进行分析总结。文章还对生成式三维重建领域常用数据集进行了归纳总结。最后,本文对生成式三维重建工作未来研究方向进行了讨论。

     

    Abstract: Inspired by the rapid progress of generative AI techniques, there have been huge advances made for the 3D (three-dimensional) reconstruction community, which promoted the traditional 3D reconstruction framework from deep implicit 3D reconstruction to generative 3D reconstruction, achieving more robust and expansive 3D reconstruction results with the help of generative AI models. Meanwhile, there is still a lack of corresponding review articles to provide a comprehensive analysis of recent advances from the perspective of 3D reconstruction. In response, this paper gives a comprehensive review for the generative 3D reconstruction approaches, especially on the recent advances made from the computer graphics and vision communities. Firstly, this paper mainly divides the recent generative 3D reconstruction approaches into four categories, including generative structure-from-motion/multiview-sterero (SfM/MVS), generative adversarial networks (GAN) based 3D reconstruction, diffusion-based 3D reconstruction, and cross-modal 3D reconstruction, which cover most generative-model aided 3D reconstruction work with a comprehensive review and analysis. Thereafter, some representative applications inspired by the generative 3D reconstruction including dynamic human avatars, 3D interactive editing, and autonomous driving are also reviewed. Besides, some major datasets widely used for the generative 3D reconstruction approaches are included. Finally, this paper makes a discussion of the potential future work in further improving the quality of generative 3D reconstruction, towards better and more intelligent 3D reconstruction and generation.

     

/

返回文章
返回