We use cookies to improve your experience with our site.
金力, 刘钢利, 赵靓, 冯铃. PhotoPrev: 联合情境和内容线索辅助个人照片回忆检索[J]. 计算机科学技术学报, 2015, 30(3): 453-466. DOI: 10.1007/s11390-015-1536-z
引用本文: 金力, 刘钢利, 赵靓, 冯铃. PhotoPrev: 联合情境和内容线索辅助个人照片回忆检索[J]. 计算机科学技术学报, 2015, 30(3): 453-466. DOI: 10.1007/s11390-015-1536-z
Li Jin, Gang-Li Liu, Liang Zhao, Ling Feng. PhotoPrev: Unifying Context and Content Cues to Enhance Personal Photo Revisitation[J]. Journal of Computer Science and Technology, 2015, 30(3): 453-466. DOI: 10.1007/s11390-015-1536-z
Citation: Li Jin, Gang-Li Liu, Liang Zhao, Ling Feng. PhotoPrev: Unifying Context and Content Cues to Enhance Personal Photo Revisitation[J]. Journal of Computer Science and Technology, 2015, 30(3): 453-466. DOI: 10.1007/s11390-015-1536-z

PhotoPrev: 联合情境和内容线索辅助个人照片回忆检索

PhotoPrev: Unifying Context and Content Cues to Enhance Personal Photo Revisitation

  • 摘要: 由于用户日常生活中常常用智能手机拍摄大量照片,所以照片回忆检索是经常性但并不容易的工作.因此,本文基于人类记忆特点开发一款个人照片回忆检索工具PhotoPrev,方便用户利用关联的记忆线索寻找曾经的照片.为了模拟用户的情节记忆,本文提出一种能够自动生成大量关联情境线索(例如,当时拍摄的天气,温度等)的方法,并结合记忆的动态生命周期将其组织成情境偏序格.同时,将对应语义记忆的照片内容(例如,对象和文本)抽取并组织成加权词表.为了提供个性化的回忆检索,本文提出基于阈值的top-k检索算法并详细设计了用户反馈调整模块.本文在大规模的模拟数据上验证系统的可扩展性,同时持续12周的用户研究证明了照片回忆检索策略的可行性和有效性.

     

    Abstract: personal photos on the smart phones is a common yet uneasy task for users due to the large volume of photos taken in daily life. Inspired by the human memory and its natural recall characteristics, we build a personal photo re-visitation tool, PhotoPrev, to facilitate users to re-find previous photos through associated memory cues. To mimic users' episodic memory recall, we present a way to automatically generate an abundance of related contextual metadata (e.g. weather, temperature, etc) and organize them as context lattices for each photo in a life cycle. Meanwhile, photo content (e.g. object,text) is extracted and managed in a weighted term list, which corresponds to semantic memory. A TA-based top-k photo re-visitation algorithm for context-and content-based keyword search on a personal photo collection, together with a user feedback mechanism, are also given. We evaluate the scalability on a large synthetic data, and a 12-week user study demonstrates the feasibility and effectiveness of our photo re-visitation strategies.

     

/

返回文章
返回