场景调色板:根据上下文探索物体集合来设计三维场景
ScenePalette: Contextually Exploring Object Collections Through Multiplex Relations in 3D Scenes
-
摘要:研究背景 现实世界的三维场景由上下文合理的物体组织组成,例如,人们通常将一张双人床而不是不同形状的床与几个从属物体放在卧室中。然而目前的工作都是根据三维物体的外形来探究他们的表示。目的 本文目的是研究如何高效的组织和表示三维物体集合。我们发现在三维场景中排布的物体,上下文的组织关系比视觉上的更重要。因此本文根据物体的上下文来构建物体的隐空间并由此允许用户通过交互生成三维场景。方法 我们抽取物体在三维场景中的不同层次的上下文关系,然后根据这些关系构建一个层级网络图。进一步的,我们将上下文相近的物体在隐空间中的距离拉近,上下文有差距的物体在隐空间的距离推远,以此来生成合理的三维物理隐空间。结果 我们发现根据上下文生成的三维物体隐空间和传统方法比起来能够更准确的建模物体间的关系。我们根据生成的三维物体表示构建了相关应用,例如高效地探索三维物体上下文,用户通过交互生成三维场景等。结论 本文证明了上下文构建三维物体隐空间的有效性。我们提出的方法在三维场景的应用中具有重要意义和潜力。同时,未来工作应该进一步探究依据人类直觉来设计三维场景表示。Abstract: This paper presents ScenePalette, a modeling tool that allows users to “draw” 3D scenes interactively by placing objects on a canvas based on their contextual relationship. ScenePalette is inspired by an important intuition which was often ignored in previous work: a real-world 3D scene consists of the contextually reasonable organization of objects, e.g. people typically place one double bed with several subordinate objects into a bedroom instead of different shapes of beds. ScenePalette, abstracts 3D repositories as multiplex networks and accordingly encodes implicit relations between or among objects. Specifically, basic statistics such as co-occurrence, in combination with advanced relations, are used to tackle object relationships of different levels. Extensive experiments demonstrate that the latent space of ScenePalette has rich contexts that are essential for contextual representation and exploration.