? 视频中静态场景光照估计及应用
Journal of Computer Science and Technology
Quick Search in JCST
 Advanced Search 
      Home | PrePrint | SiteMap | Contact Us | Help
 
Indexed by   SCIE, EI ...
Bimonthly    Since 1986
Journal of Computer Science and Technology 2017, Vol. 32 Issue (3) :430-442    DOI: 10.1007/s11390-017-1734-y
Special Section of CVM 2017 << Previous Articles | Next Articles >>
视频中静态场景光照估计及应用
Bin Liu1, Kun Xu1,*, Member, CCF, ACM, IEEE, Ralph R. Martin2, Member, ACM, IEEE
1. Department of Computer Science and Technology, Tsinghua University, Beijing 100084, China;
2. School of Computer Science and Informatics, Cardiff University, Cardiff CF24 3AA, U.K
Static Scene Illumination Estimation from Video with Applications
Bin Liu1, Kun Xu1,*, Member, CCF, ACM, IEEE, Ralph R. Martin2, Member, ACM, IEEE
1. Department of Computer Science and Technology, Tsinghua University, Beijing 100084, China;
2. School of Computer Science and Informatics, Cardiff University, Cardiff CF24 3AA, U.K

摘要
参考文献
相关文章
Download: [PDF 6178KB]  
摘要 我们提出了一个系统,能从视频中自动恢复场景几何和光照,并支持多种应用。以往的基于图像的光照恢复方法或需要用户交互,或需要大量数据驱动。我们采用SFM和多视角三维重建算法构建场景几何结构,再估计环境光的球面谐波系数(实验表明球面谐波的效果要好于其他基函数)。我们展示了基于几何和光照恢复的应用,包括虚拟物体嵌入(增强现实),阴影检测和视频重新打光。
关键词视频处理   增强现实   光照恢复     
Abstract: We present a system that automatically recovers scene geometry and illumination from a video, providing a basis for various applications. Previous image based illumination estimation methods either require user interaction or external information in the form of a database. We adopt structure-from-motion and multi-view stereo for initial scene reconstruction, and then estimate an environment map represented by spherical harmonics (as these perform better than other bases). We also demonstrate several video editing applications that exploit the recovered geometry and illumination, including object insertion (e.g. for augmented reality), shadow detection, and video relighting.
Keywordsvideo processing   augmented reality   illumination recovery     
Received 2016-12-18;
本文基金:

This work was supported by the National Natural Science Foundation of China (NSFC) and the Israel Science Foundation (ISF),Joint NSFC-ISF Research Program under Grant No.61561146393,the National Natural Science Foundation of China under Grant No.61521002,a research grant from the Beijing Higher Institution Engineering Research Center,and the Tsinghua-Tencent Joint Laboratory for Internet Innovation Technology.

通讯作者: Kun Xu     Email: xukun@tsinghua.edu.cn
About author: Bin Liu is a Ph.D.student in the Department of Computer Science and Technology,Tsinghua University, Beijing.He received his Bachelor's degree in computer science from the same university in 2013.His research interests include image and video editing.
引用本文:   
Bin Liu, Kun Xu, Ralph R. Martin.视频中静态场景光照估计及应用[J]  Journal of Computer Science and Technology , 2017,V32(3): 430-442
Bin Liu, Kun Xu, Ralph R. Martin.Static Scene Illumination Estimation from Video with Applications[J]  Journal of Computer Science and Technology, 2017,V32(3): 430-442
链接本文:  
http://jcst.ict.ac.cn:8080/jcst/CN/10.1007/s11390-017-1734-y
Copyright 2010 by Journal of Computer Science and Technology