We use cookies to improve your experience with our site.

多来源视角感知的图像物体合成和综合方法

View-Aware Image Object Compositing and Synthesis from Multiple Sources

  • 摘要: 图像合成是一种广泛使用的技术, 它将来自多个源图像的视觉元素组合到一张图像中。尽管现有的图像合成技术能够实现多来源视觉元素的光滑混合, 大部分的技术仍然隐性假定源图像都采用相同视角。在本工作中, 我们提出了一种能从不同视角的源图像合成新图像物体的方法。我们的关键技术在于为源图像物体的组件构造有意义的三维形状代理, 并使用这些代理将图像组件扭曲到同一个视角并进行无缝接合。为实现此想法, 我们引入了一种基于标架的单视角相机校准算法来处理一般类型的图像物体;提出了一种结构感知的优化算法来得到图像物体组件的块状代理并提取正确的结构关系;给出了一个三维代理空间变换引导下的图像扭曲算法来接合图像物体组件。我们基于此合成方法进一步给出了一个新应用, 从一组样例中自动化地综合出大量的图像物体。实验结果表明我们的合成方法能够被用于一系列不同类型的图像物体, 包括椅子、杯子、台灯、机器人以及飞机等等, 我们的综合方法能够从一小组样例中创造出有显著形状和风格变化的新图像物体。

     

    Abstract: Image compositing is widely used to combine visual elements from separate source images into a single image. Although recent image compositing techniques are capable of achieving smooth blending of the visual elements from different sources, most of them implicitly assume the source images are taken in the same viewpoint. In this paper, we present an approach to compositing novel image objects from multiple source images which have different viewpoints. Our key idea is to construct 3D proxies for meaningful components of the source image objects, and use these 3D component proxies to warp and seamlessly merge components together in the same viewpoint. To realize this idea, we introduce a coordinateframe based single-view camera calibration algorithm to handle general types of image objects, a structure-aware cuboid optimization algorithm to get the cuboid proxies for image object components with correct structure relationship, and finally a 3D-proxy transformation guided image warping algorithm to stitch object components. We further describe a novel application based on this compositing approach to automatically synthesize a large number of image objects from a set of exemplars. Experimental results show that our compositing approach can be applied to a variety of image objects, such as chairs, cups, lamps, and robots, and the synthesis application can create novel image objects with significant shape and style variations from a small set of exemplars.

     

/

返回文章
返回