Journal of Computer Science and Technology

   

ScenePalette: Contextually Exploring Object Collections through Multiplex Relations in 3D Scenes

Shao-Kui Zhang1 (张少魁), Member, CCF, ACM, Wei-Yu Xie1 (谢威宇), Member, CCF, ACM, Chen Wang1 (王琛), Member, CCF, IEEE, and Song-Hai Zhang1,2,∗ (张松海), Member, CCF, ACM, IEEE   

  1. 1Department of Computer Science and Technology, Tsinghua University, Beijing, 100084, China
    2Beijing National Research Center for Information Science and Technology, Beijing, 100084, China
  • Received:2022-02-08 Revised:2022-10-10 Accepted:2022-12-24
  • Contact: Song-Hai Zhang E-mail:shz@tsinghua.edu.cn
  • About author:Song-Hai Zhang received his PhD degree of computer science and technology from Tsinghua University, Beijing, in 2007. He is currently an associate professor in the Department of Computer Science and Technology at Tsinghua University. His research interests include computer graphics and virtual reality.

This paper presents ScenePalette, a modeling tool that allows users to “draw” 3D scenes interactively by placing objects on a canvas based on their contextual relationship. ScenePalette is inspired by an important intuition but often ignored in previous works: a real-world 3D scene consists of the contextually reasonable organization of objects, e.g. people typically place one double bed with several subordinate objects into a bedroom instead of different shapes of beds. ScenePalette, abstracts 3D repositories as multiplex networks and accordingly encodes implicit relations between or among objects. Specifically, basic statistics such as co-occurrence, in combination with advanced relations, are used to tackle object relationships of different levels. Extensive experiments demonstrate that the latent space of ScenePalette has rich contexts that are essential for contextual representation and exploration.


中文摘要

1、研究背景(context):
现实世界的三维场景由上下文合理的物体组织组成,例如,人们通常将一张双人床而不是不同形状的床与几个从属物体放在卧室中。然而目前的工作都是根据三维物体的外形来探究他们的表示。
2、目的(Objective):
本文目的是研究如何高效的组织和表示三维物体集合。我们发现在三维场景中排布的物体,上下文的组织关系比视觉上的更重要。因此本文根据物体的上下文来构建物体的隐空间并由此允许用户通过交互生成三维场景。
3、方法(Method):
我们抽取物体在三维场景中的不同层次的上下文关系,然后根据这些关系构建一个层级网络图。进一步的,我们将上下文相近的物体在隐空间中的距离拉近,上下文有差距的物体在隐空间的距离推远,以此来生成合理的三维物理隐空间。
4、结果(Result & Findings):
我们发现根据上下文生成的三维物体隐空间和传统方法比起来能够更准确的建模物体间的关系。我们根据生成的三维物体表示构建了相关应用,例如高效地探索三维物体上下文,用户通过交互生成三维场景等。
5、结论(Conclusions):
本文证明了上下文构建三维物体隐空间的有效性。我们提出的方法在三维场景的应用中具有重要意义和潜力。同时,未来工作应该进一步探究依据人类直觉来设计三维场景表示。

Key words: computer graphics; 3D scene contexts; 3D repository exploration; multiplex network embedding;

[1] Bo Ren, Xu-Yun Yang, Ming C. Lin, Nils Thuerey, Matthias Teschner, Chenfeng Li. Visual Simulation of Multiple Fluids in Computer Graphics: A State-of-the-Art Report [J]. , 2018, 33(3): 431-451.
[2] Ming-Ming Cheng, Qi-Bin Hou, Song-Hai Zhang, Paul L. Rosin. Intelligent Visual Media Processing: When Graphics Meets Vision [J]. , 2017, 32(1): 110-121.
[3] Bai-Lin Yang, Frederick W. B. Li, Zhi-Geng Pan, and Xun Wang. An Effective Error Resilient Packetization Scheme for Progressive Mesh Transmission over Unreliable Networks [J]. , 2008, 23(6 ): 1015-1025 .
[4] Yong-Wei Miao, Jie-Qing Feng, Chun-Xia Xiao, Qun-Sheng Peng and A.R. Forrest. Differentials-based segmentation and parameterization for point-sampled surfaces [J]. , 2007, 22(5): 749-760 .
[5] Feng Xue, You-Sheng Zhang, Ju-Lang Jiang, Min Hu, Xin-Dong Wu, and Rong-Gui Wang. Real-Time Texture Synthesis Using s-Tile Set [J]. , 2007, 22(4): 590-596 .
[6] Xue-Ying Qin, Eihachiro Nakamae, Wei Hua, Yasuo Nagai, and Qun-Sheng Peng. Anti-Aliased Rendering of Water Surface [J]. , 2004, 19(5): 0-0.
[7] Fu-Li Wu, Chun-Hui Mei, and Jiao-Ying Shi. Method of Direct Texture Synthesis on Arbitrary Surfaces [J]. , 2004, 19(5): 0-0.
[8] A. R. Forrest. Future Trends in Computer Graphics: How Much is Enough? [J]. , 2003, 18(5): 0-0.
[9] Liang Xundong; Li Bin; Liu Shenquan;. Three-Dimensional Vector Field Visualization Based on Tensor Decomposition [J]. , 1996, 11(5): 452-460.
[10] Qin Kaihuai; Gong Minglun; Tong Geliang;. Fast Ray Tracing NURBS Surfaces [J]. , 1996, 11(1): 17-29.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!

ISSN 1000-9000(Print)

         1860-4749(Online)
CN 11-2296/TP

Home
Editorial Board
Author Guidelines
Subscription
Journal of Computer Science and Technology
Institute of Computing Technology, Chinese Academy of Sciences
P.O. Box 2704, Beijing 100190 P.R. China
Tel.:86-10-62610746
E-mail: jcst@ict.ac.cn
 
  Copyright ©2015 JCST, All Rights Reserved