Journal of Computer Science and Technology
Quick Search in JCST
 Advanced Search 
      Home | PrePrint | SiteMap | Contact Us | Help
 
Indexed by   SCIE, EI ...
Bimonthly    Since 1986
Journal of Computer Science and Technology 2015, Vol. 30 Issue (3) :453-466    DOI: 10.1007/s11390-015-1536-z
Special Section on Computational Visual Media << Previous Articles | Next Articles >>
PhotoPrev: 联合情境和内容线索辅助个人照片回忆检索
Li Jin(金力), Gang-Li Liu(刘钢利), Liang Zhao(赵靓), Ling Feng(冯铃), Senior Member, IEEE
Tsinghua National Laboratory for Information Science and Technology, Department of Computer Science and Technology Tsinghua University, Beijing 100084, China
PhotoPrev: Unifying Context and Content Cues to Enhance Personal Photo Revisitation
Li Jin(金力), Gang-Li Liu(刘钢利), Liang Zhao(赵靓), Ling Feng(冯铃), Senior Member, IEEE
Tsinghua National Laboratory for Information Science and Technology, Department of Computer Science and Technology Tsinghua University, Beijing 100084, China

摘要
参考文献
相关文章
Download: [PDF 2141KB]  
摘要 由于用户日常生活中常常用智能手机拍摄大量照片,所以照片回忆检索是经常性但并不容易的工作.因此,本文基于人类记忆特点开发一款个人照片回忆检索工具PhotoPrev,方便用户利用关联的记忆线索寻找曾经的照片.为了模拟用户的情节记忆,本文提出一种能够自动生成大量关联情境线索(例如,当时拍摄的天气,温度等)的方法,并结合记忆的动态生命周期将其组织成情境偏序格.同时,将对应语义记忆的照片内容(例如,对象和文本)抽取并组织成加权词表.为了提供个性化的回忆检索,本文提出基于阈值的top-k检索算法并详细设计了用户反馈调整模块.本文在大规模的模拟数据上验证系统的可扩展性,同时持续12周的用户研究证明了照片回忆检索策略的可行性和有效性.
关键词照片回忆检索   记忆线索   用户反馈     
Abstract: personal photos on the smart phones is a common yet uneasy task for users due to the large volume of photos taken in daily life. Inspired by the human memory and its natural recall characteristics, we build a personal photo re-visitation tool, PhotoPrev, to facilitate users to re-find previous photos through associated memory cues. To mimic users' episodic memory recall, we present a way to automatically generate an abundance of related contextual metadata (e.g. weather, temperature, etc) and organize them as context lattices for each photo in a life cycle. Meanwhile, photo content (e.g. object,text) is extracted and managed in a weighted term list, which corresponds to semantic memory. A TA-based top-k photo re-visitation algorithm for context-and content-based keyword search on a personal photo collection, together with a user feedback mechanism, are also given. We evaluate the scalability on a large synthetic data, and a 12-week user study demonstrates the feasibility and effectiveness of our photo re-visitation strategies.
KeywordsPersonal photo re-visitation   memory cues   user feedback     
Received 2014-12-01;
本文基金:

The work was supported by the National Natural Science Foundation of China under Grant Nos. 61373022, 61073004, and the National Basic Research 973 Program of China under Grant No. 2011CB302203-2.

About author: Li Jin received his Bachelor's degree in computer science and technology from Xidian University, Xi'an, in 2012. He is currently a Ph.D. candidate in the Department of Computer Science and Technology, Tsinghua University, Beijing. His research interests include context-aware data management and context-based information refinding.
引用本文:   
Li Jin, Gang-Li Liu, Liang Zhao, Ling Feng.PhotoPrev: 联合情境和内容线索辅助个人照片回忆检索[J]  Journal of Computer Science and Technology , 2015,V30(3): 453-466
Li Jin, Gang-Li Liu, Liang Zhao, Ling Feng.PhotoPrev: Unifying Context and Content Cues to Enhance Personal Photo Revisitation[J]  Journal of Computer Science and Technology, 2015,V30(3): 453-466
链接本文:  
http://jcst.ict.ac.cn:8080/jcst/CN/10.1007/s11390-015-1536-z
Copyright 2010 by Journal of Computer Science and Technology