PhotoPrev: Unifying Context and Content Cues to Enhance Personal Photo Revisitation

personal photos on the smart phones is a common yet uneasy task for users due to the large volume of photos taken in daily life. Inspired by the human memory and its natural recall characteristics, we build a personal photo re-visitation tool, PhotoPrev, to facilitate users to re-find previous photos through associated memory cues. To mimic users' episodic memory recall, we present a way to automatically generate an abundance of related contextual metadata (e.g. weather, temperature, etc) and organize them as context lattices for each photo in a life cycle. Meanwhile, photo content (e.g. object,text) is extracted and managed in a weighted term list, which corresponds to semantic memory. A TA-based top-k photo re-visitation algorithm for context-and content-based keyword search on a personal photo collection, together with a user feedback mechanism, are also given. We evaluate the scalability on a large synthetic data, and a 12-week user study demonstrates the feasibility and effectiveness of our photo re-visitation strategies.