A Survey of Recent Advances in Generative 3D Reconstruction

Inspired by the rapid progress of generative AI techniques, there have been huge advances made for the 3D reconstruction community, which promoted the traditional 3D reconstruction framework from deep implicit 3D reconstruction to generative 3D reconstruction, achieving more robust and expansive 3D reconstruction results with the help of generative AI models. Meanwhile, there is still a lack of corresponding review articles to provide a comprehensive analysis of these recent advances from the perspective of 3D reconstruction. In response, this paper gives a comprehensive review for the generative 3D reconstruction approaches, especially on the recent advances made from the computer graphics and vision communities. Firstly, this paper mainly divides the recent generative 3D reconstruction approaches into four categories, including generative Sf M/MVS, GAN-based 3D reconstruction, diffusion-based 3D reconstruction, and cross-modal 3D reconstruction, which cover most generative model-aided 3D reconstruction works with a comprehensive review and analysis. Thereafter, some representative applications which are inspired by the generative 3D reconstruction techniques, including dynamic human avatars, 3D interactive editing and autonomous driving, are also reviewed. Besides, some major datasets which are commonly used for the current generative 3D reconstruction approaches are included. Finally, this paper makes a discussion of the potential future work in further improving generative 3D reconstruction, towards better and more intelligent 3D reconstruction and generation.