›› 2013, Vol. 28 ›› Issue (5): 776-787.doi: 10.1007/s11390-013-1376-7

Special Issue: Artificial Intelligence and Pattern Recognition

• Special Section of CVM2013 • Previous Articles     Next Articles

A Novel Approach Based on Multi-View Content Analysis and SemiSupervised Enrichment for Movie Recommendation

Wen Qu (屈雯), Student Member, CCF, Kai-Song Song (宋凯嵩), Student Member, CCF Yi-Fei Zhang (张一飞), Member, CCF, Shi Feng (冯时), Member, CCF, Da-Ling Wang (王大玲), Member, CCF and Ge Yu* (于戈), Senior Member, CCF, Member, ACM, IEEE   

  1. School of Information Science and Engineering, Northeastern University, Shenyang 110819, China
  • Received:2013-05-05 Revised:2013-08-14 Online:2013-09-05 Published:2013-09-05
  • Supported by:

    Supported by the National Basic Research 973 Program of China under Grant No. 2011CB302200-G, the Key Program of National Natural Science Foundation of China under Grant No. 61033007, the National Natural Science Foundation of China under Grant Nos. 61100026, 60973019, and the Fundamental Research Funds for the Central Universities of China under Grant Nos. N110604003, N100704001, N100304004, N120404007.

Although many existing movie recommender systems have investigated recommendation based on information such as clicks and tags, much less efforts have been made to explore the multimedia content of movies, which has potential information for the elicitation of the user's visual and musical preferences. In this paper, we explore the content from three media types (image, text, audio) and propose a novel multi-view semi-supervised movie recommendation method, which represents each media type as a view space for movies. The three views of movies are integrated to predict the rating values under the multi-view framework. Furthermore, our method considers the casual users who rate limited movies. The algorithm enriches the user profile with a semi-supervised way when there are only few rating histories. Experiments indicate that the multimedia content analysis reveals the user's profile in a more comprehensive way. Different media types can be a complement to each other for movie recommendation. And the experimental results validate that our semi-supervised method can effectively enrich the user profile for recommendation with limited rating history.

[1] Park J, Lee S J, Lee S J et al. Online video recommendation through tag-cloud aggregation. IEEE MultiMedia, 2011, 18(1): 78-87.

[2] Hu J, Wang B, Liu Y, Li D Y. Personalized tag recommendation using social infiuence. Journal of Computer Science and Technology, 2012, 27(3): 527-540.

[3] Manzato M G. Discovering latent factors from movies genres for enhanced recommendation. In Proc. the 6th ACM Conference on Recommender Systems, Sept. 2012, pp.249-252.

[4] Qumsiyeh R, Ng Y K. Predicting the ratings of multimedia items for making personalized recommendations. In Proc. the 35th ACM SIGIR Int. Conf. Research and Development in Information Retrieval, Aug. 2012, pp.475-484.

[5] Davidson J, Liebald B, Liu J et al. The YouTube video recommendation system. In Proc. the 4th ACM Conference on Recommender Systems, Sept. 2010, pp.293-296.

[6] Chen B, Wang J, Huang Q, Mei T. Personalized video recommendation through tripartite graph propagation. In Proc. the 20th ACM Int. Conf. Multimedia, Oct. 2012, pp.1133-1136.

[7] Zhao X, Li G, Wang M et al. Integrating rich Information for video recommendation with multi-task rank aggregation. In Proc. the 19th ACM Int. Conf. Multimedia, Nov. 2011, pp.1521-1534.

[8] Esparza S G, O'Mahony M P, Smyth B. On the real-time web as a source of recommendation knowledge. In Proc. the 4th ACM Conf. Recommender Systems, Sept. 2010, pp.305-308.

[9] Mei T, Yang B, Hua X S, Li S. Contextual video recommendation by multimodal relevance and user feedback. ACM Transactions on Information Systems, 2011, 29(2): Article No. 10.

[10] Toutanova K, Klein D, Manning C D, Singer Y. Feature-rich part-of-speech tagging with a cyclic dependency network. In Proc. the 2003 Conf. the North American Chapter of the Association for Computational Linguistics on Human Language Technologies, May 2003, pp.173-180.

[11] Carrer-Neto W, Hernandez-Alcaraz M L, Valencia-Garcia R, Garcia-Sanchez F. Social knowledge-based recommender system. Application to the movies domain. Journal of Expert Systems with Applications, 2012, 39(12): 10990-11000.

[12] Said A. Identifying and utilizing contextual data in hybrid recommender systems. In Proc. the 4th ACM Conference on Recommender Systems, Sept. 2010, pp.365-368.

[13] Shi Y, Larson M, Hanjalic A. Mining mood-speci-c movie similarity with matrix factorization for context-aware recommendation. In Proc. the Workshop on Context-Aware Movie Recommendation, Sept. 2010, pp.34-40.

[14] Ganter Z, Rendle S, Schimidt-Thieme L. Factorization models for context-time-aware movie recommendations. In Proc. the Workshop on Context-Aware Movie Recommendation, Sept. 2010, pp.14-19.

[15] Biancalana C, Gasparetti F, Micarelli A, Miola A, Sansonetti G. Context-aware movie recommendation based on signal processing and machine learning. In Proc. the 2nd Challenge on Context-Aware Movie Recommendation, Oct. 2011, pp.5-10.

[16] Chen T, Lu A, Hu S M. Visual storylines: Semantic visualization of movie sequence. Computer & Graphics, 2012, 36(4): 241-249.

[17] Parry M L, Legg P A, Chung D H S et al. Hierarchical event selection for video storyboards with a case study on snooker video visualization. IEEE Trans. Visualization and Computer Graphics, 2011, 17(12): 1747-1756.

[18] Hoeferlin M, Kurzhals K, Hoeferlin B et al. Evaluation of fast-forward video visualization. IEEE Trans. Visualization and Computer Graphics, 2012, 18(12): 2095-2103.

[19] Yarowsky D. Unsupervised word sense disambiguation rivaling supervised methods. In Proc. the 33rd Meeting on Association for Computational Linguistics, June 1995, pp.189-196.

[20] Usunier N, Amini M R, Goutte C. Multiview semi-supervised learning for ranking multilingual documents. In Proc. the 2011 European Conf. Machine Learning and Knowledge Discovery in Databases, Sept. 2011, Vol.3, pp.443-458.

[21] Smeulders A W M, Worring M, Santini S et al. Contentbased image retrieval at the end of the early years. IEEE Trans. Pattern Analysis and Machine Intelligence, 2000, 22(12): 1349-1380.

[22] Solli M, Lenz R. Color emotions for image classi-cation and retrieval. In Proc. the 4th European Conference on Colour in Graphics, Imaging, and Vision, June 2008, pp.367-371.

[23] Wang X H, Jia J, Liao H Y, Cai L H. Affective image colorization. Journal of Computer Science and Technology, 2012, 27(6): 1119-1128.

[24] Ou L, Luo M, Woodcock A et al. A study of colour emotion and colour preference——Part 1: Colour emotion for single colours. Color Research & Application, 2005, 29(3): 232-240.

[25] Varam M, Zisserman A. A statistical approach to texture classi-cation from single images. Journal of Computer Vision, 2005, 62(1/2): 61-81.

[26] Toutanova K, Klein D, Manning C D, Singer Y. Feature-rich part-of-speech tagging with a cyclic dependency network. In Proc. the 2003 Conf. the North American Chapter of the Association for Computational Linguistics on Human Language Technologies, May 2003, pp.173-180.

[27] Finkel J R, Grenager T, Manning C. Incorporating non-local information into information extraction systems by Gibbs sampling. In Proc. the 43rd Annual Meeting on Association for Computational Linguistics, June 2005, pp.363-370.

[28] Porter M F. An algorithm for suflx stripping. In Readings in Information Retrieval, Jones K S, Willett P (eds.), Morgan Kaufmann Publishers Inc., 1997, pp.313-317.

[29] Scherer K R, Zentner M R. Emotional effects of music: Production rules. In Music and Emotion: Theory and Research, Juslin P, Sloboda J (eds.), New York: Oxford University Press, 2001, pp.361-387.

[30] Hunter P G, Schellenburg E G, Schimmack U. Feelings and perceptions of happiness and sadness induced by music: Similarities, differences, and mixed emotions. Psychology of Aesthetics, Creativity and the Arts, 2010, 4(1): 47-56.

[31] Logan B. Mel frequency cepstral coeffcients for music modeling. In Proc. Int. Symp. Music Information Retrieval, Oct. 2000.

[32] Casey M A, Veltkamp R, Goto M, Leman M, Rhodes C, Slaney M. Content-based music information retrieval: Current directions and future challenges. Proceedings of the IEEE, 2008, 96(4):668-696.

[33] McKinneyM F, Breeebat J. Features for audio and music classi-cation. In Proc. the International Symposium on Music Information Retrieval, Oct. 2003.

[34] Gabrielsson A, Lindstrom E. The infiuence of musical structure on emotional expression. In Music and Emotion: Theory and Research, Juslin P N, Sloboda J A (eds.), New York: Oxford University Press, 2001, pp.23-248.

[35] Zhang J, Marszalek M, Lazebnik S et al. Local features and kernels for classi-cation of texture and object categories: A comprehensive study. J. Computer Vision, 2007, 73(2): 213238.

[36] Lartillot O, Toiviainen P. A Matlab toolbox for musical feature extraction from audio. In Proc. the 10th International Conference on Digital Audio Effects, Sept. 2007.

[37] Ricci F, Rokach L, Shapira B, Knator P B. Recommender Systems Handbook. Springer, 2011.
No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
[1] Liu Mingye; Hong Enyu;. Some Covering Problems and Their Solutions in Automatic Logic Synthesis Systems[J]. , 1986, 1(2): 83 -92 .
[2] Chen Shihua;. On the Structure of (Weak) Inverses of an (Weakly) Invertible Finite Automaton[J]. , 1986, 1(3): 92 -100 .
[3] Gao Qingshi; Zhang Xiang; Yang Shufan; Chen Shuqing;. Vector Computer 757[J]. , 1986, 1(3): 1 -14 .
[4] Chen Zhaoxiong; Gao Qingshi;. A Substitution Based Model for the Implementation of PROLOG——The Design and Implementation of LPROLOG[J]. , 1986, 1(4): 17 -26 .
[5] Huang Heyan;. A Parallel Implementation Model of HPARLOG[J]. , 1986, 1(4): 27 -38 .
[6] Min Yinghua; Han Zhide;. A Built-in Test Pattern Generator[J]. , 1986, 1(4): 62 -74 .
[7] Tang Tonggao; Zhao Zhaokeng;. Stack Method in Program Semantics[J]. , 1987, 2(1): 51 -63 .
[8] Min Yinghua;. Easy Test Generation PLAs[J]. , 1987, 2(1): 72 -80 .
[9] Zhu Hong;. Some Mathematical Properties of the Functional Programming Language FP[J]. , 1987, 2(3): 202 -216 .
[10] Li Minghui;. CAD System of Microprogrammed Digital Systems[J]. , 1987, 2(3): 226 -235 .

ISSN 1000-9000(Print)

         1860-4749(Online)
CN 11-2296/TP

Home
Editorial Board
Author Guidelines
Subscription
Journal of Computer Science and Technology
Institute of Computing Technology, Chinese Academy of Sciences
P.O. Box 2704, Beijing 100190 P.R. China
Tel.:86-10-62610746
E-mail: jcst@ict.ac.cn
 
  Copyright ©2015 JCST, All Rights Reserved