We use cookies to improve your experience with our site.

Indexed in:

SCIE, EI, Scopus, INSPEC, DBLP, CSCD, etc.

Submission System
(Author / Reviewer / Editor)
Advanced Search
Volume 35 Issue 3
May  2020
Turn off MathJax
Article Contents
Abstract
References
Related Articles
Supplements
Rui-Song Zhang, Wei-Ze Quan, Lu-Bin Fan, Li-Ming Hu, Dong-Ming Yan. Distinguishing Computer-Generated Images from Natural Images Using Channel and Pixel Correlation[J]. Journal of Computer Science and Technology, 2020, 35(3): 592-602. DOI: 10.1007/s11390-020-0216-9
Citation: Rui-Song Zhang, Wei-Ze Quan, Lu-Bin Fan, Li-Ming Hu, Dong-Ming Yan. Distinguishing Computer-Generated Images from Natural Images Using Channel and Pixel Correlation[J]. Journal of Computer Science and Technology, 2020, 35(3): 592-602. DOI: 10.1007/s11390-020-0216-9
shu

Distinguishing Computer-Generated Images from Natural Images Using Channel and Pixel Correlation

  • 1 National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing 100190, China;
    2 School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing 100049, China;
    3 Alibaba Group, Hangzhou 310023, China;
    4 State Key Laboratory of Hydro-Science and Engineering, Tsinghua University, Beijing 100084, China

Funds: This work was supported by the National Key Research and Development Program of China under Grant No. 2019YFB2204104, the Beijing Natural Science Foundation of China under Grant No. L182059, the National Natural Science Foundation of China under Grant Nos. 61772523, 61620106003, and 61802406, Alibaba Group through Alibaba Innovative Research Program, and the Joint Open Research Fund Program of State Key Laboratory of Hydroscience and Engineering and Tsinghua-Ningxia Yinchuan Joint Institute of Internet of Waters on Digital Water Governance.
More Information
  • Author Bio:

    Rui-Song Zhang is currently pursuing his M.S. degree in the National Laboratory of Pattern Recognition (NLPR), Institute of Automation, Chinese Academy of Sciences, Beijing. He received his B.S. degree in information security from Xidian University, Xi'an, in 2019. His research interests include image processing and image forensics.

  • Corresponding author:

    Dong-Ming Yan E-mail: yandongming@gmail.com

  • Received Date: December 09, 2019
  • Revised Date: January 04, 2020
  • Published Date: May 27, 2020
    Abstract
  • With the recent tremendous advances of computer graphics rendering and image editing technologies, computergenerated fake images, which in general do not reflect what happens in the reality, can now easily deceive the inspection of human visual system. In this work, we propose a convolutional neural network (CNN)-based model to distinguish computergenerated (CG) images from natural images (NIs) with channel and pixel correlation. The key component of the proposed CNN architecture is a self-coding module that takes the color images as input to extract the correlation between color channels explicitly. Unlike previous approaches that directly apply CNN to solve this problem, we consider the generality of the network (or subnetwork), i.e., the newly introduced hybrid correlation module can be directly combined with existing CNN models for enhancing the discrimination capacity of original networks. Experimental results demonstrate that the proposed network outperforms state-of-the-art methods in terms of classification performance. We also show that the newly introduced hybrid correlation module can improve the classification accuracy of different CNN architectures.
    • FullText(HTML)
    • References (31)
  • [1]
    He P, Jiang X, Sun T, Li H. Computer graphics identification combining convolutional and recurrent neural networks. IEEE Signal Processing Letters, 2018, 25(9):1369-1373.
    [2]
    Ng T T, Chang S F, Hsu J, Xie L, Tsui M P. Physicsmotivated features for distinguishing photographic images and computer graphics. In Proc. the 13th ACM International Conference on Multimedia, November 2005, pp.239-248.
    [3]
    Lyu S, Farid H. How realistic is photorealistic?IEEE Transactions on Signal Processing, 2005, 53(2):845-850.
    [4]
    Chen W, Shi Y Q, Xuan G. Identifying computer graphics using HSV color model and statistical moments of characteristic functions. In Proc. the 2007 IEEE International Conference on Multimedia&Expo, July 2007, pp.1123-1126.
    [5]
    Gallagher A C, Chen T. Image authentication by detecting traces of demosaicing. In Proc. the 2008 IEEE Conference on Computer Vision and Pattern Recognition, June 2008.
    [6]
    Sankar G, Zhao H V, Yang Y H. Feature based classification of computer graphics and real images. In Proc. the IEEE International Conference on Acoustics, Speech and Signal Processing, April 2009, pp.1513-1516.
    [7]
    Peng F, Zhou D l, Long M, Sun X M. Discrimination of natural images and computer generated graphics based on multi-fractal and regression analysis. AEU-International Journal of Electronics and Communications, 2017, 71:72-81.
    [8]
    Rahmouni N, Nozick V, Yamagishi J, Echizen I. Distinguishing computer graphics from natural images using convolution neural networks. In Proc. the 2017 IEEE International Workshop on Information Forensics and Security, December 2017.
    [9]
    Yu I, Kim D, Park J, Hou J, Choi S, Lee H. Identifying photorealistic computer graphics using convolutional neural networks. In Proc. the IEEE International Conference on Image Processing, September 2017, pp.4093-4097.
    [10]
    Quan W, Wang K, Yan D M, Zhang X. Distinguishing between natural and computer-generated images using convolutional neural networks. IEEE Transactions on Information Forensics and Security, 2018, 13(11):2772-2787.
    [11]
    Yao Y, Hu W, Zhang W, Wu T, Shi Y Q. Distinguishing computer-generated graphics from natural images based on sensor pattern noise and deep learning. Sensors, 2018, 18(4):Article No. 1296.
    [12]
    Nguyen H H, Yamagishi J, Echizen I. Capsule-forensics:Using capsule networks to detect forged images and videos. In Proc. the 2019 IEEE International Conference on Acoustics, Speech and Signal Processing, May 2019, pp.2307-2311.
    [13]
    Popescu A C, Farid H. Exposing digital forgeries by detecting traces of resampling. IEEE Transactions on Signal Processing, 2005, 53(2):758-767.
    [14]
    Ianeva T I, de Vries A P, Röhrig H. Detecting cartoons:A case study in automatic video-genre classification. In Proc. the 2003 IEEE International Conference on Multimedia&Expo, July 2003, pp.449-452.
    [15]
    Pan F, Chen J, Huang J. Discriminating between photorealistic computer graphics and natural images using fractal geometry. Science in China Series F:Information Sciences, 2009, 52(2):329-337.
    [16]
    Zhang R, Wang R D, Ng T T. Distinguishing photographic images and photorealistic computer graphics using visual vocabulary on local image edges. In Proc. the 10th International Workshop on Digital Forensics and Watermarking, October 2012, pp.292-305.
    [17]
    Li Z, Ye J, Shi Y Q. Distinguishing computer graphics from photographic images using local binary patterns. In Proc. the 11th International Workshop on Digital Forensics and Watermarking, October 2012, pp.228-241.
    [18]
    Ojala T, Pietikäinen M, Maenpaa T. Multiresolution grayscale and rotation invariant texture classification with local binary patterns. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2002, 24(7):971-987.
    [19]
    LeCun Y, Bengio Y, Hinton G. Deep learning. Nature, 2015, 521(7553):436-444.
    [20]
    Zhang X J, Lu Y F, Zhang S H. Multi-task learning for food identification and analysis with deep convolutional neural networks. Journal of Computer Science and Technology, 2016, 31(3):489-500.
    [21]
    Cheng M M, Hou Q B, Zhang S H, Rosin P L. Intelligent visual media processing:When graphics meets vision. Journal of Computer Science and Technology, 2017, 32(1):110-121.
    [22]
    Quan W, Yan D M, Guo J, Meng W, Zhang X. Maximal Poisson-disk sampling via sampling radius optimization. In Proc. the SIGGRAPH ASIA, December 2016, Article No. 22.
    [23]
    Barnes C, Zhang F L. A survey of the state-of-the-art in patch-based synthesis. Computational Visual Media, 2017, 3(1):3-20.
    [24]
    Hinton G E, Krizhevsky A, Wang S D. Transforming autoencoders. In Proc. the 21st International Conference on Artificial Neural Networks, June 2011, pp.44-51.
    [25]
    Sabour S, Frosst N, Hinton G E. Dynamic routing between capsules. In Proc. the 2017 Annual Conference on Neural Information Processing Systems, December 2017, pp.3856-3866.
    [26]
    Tarianga B D, Senguptab P, Roy A, Chakraborty R S, Naskar R. Classification of computer generated and natural images based on efficient deep convolutional recurrent attention model. In Proc. the IEEE Conference on Computer Vision and Pattern Recognition Workshops, June 2019, pp.146-152.
    [27]
    Yan Y, Ren W, Cao X. Recolored image detection via a deep discriminative model. IEEE Transactions on Information Forensics and Security, 2019, 14(1):5-17.
    [28]
    Bottou L. Large-scale machine learning with stochastic gradient descent. In Proc. the 19th International Conference on Computational Statistics, August 2010, pp.177-186.
    [29]
    Dang-Nguyen D T, Pasquini C, Conotter V, Boato G. RAISE:A raw images dataset for digital image forensics. In Proc. the 6th ACM Multimedia Systems Conference, March 2015, pp.219-224.
    [30]
    Ng T T, Chang S F, Hsu J, Pepeljugoski M. Columbia photographic images and photorealistic computer graphics dataset. Technical Report, Department of Electrical Engineering, Columbia University, 2004. http://www.ee.columbia.edu/ln/dvmm/publications/05/ng cgdataset 05.pdf, Jan. 2019.
    [31]
    Gunturk B K, Altunbasak Y, Mersereau R M. Color plane interpolation using alternating projections. IEEE Transactions on Image Processing, 2002, 11(9):997-1013.
    • Relative Articles

  • Related Articles

    [1]Di Wang, Jin-Shan Pan, Jin-Hui Tang. Single Image Deraining Using Residual Channel Attention Networks[J]. Journal of Computer Science and Technology, 2023, 38(2): 439-454. DOI: 10.1007/s11390-022-0979-2
    [2]Xiao-Qing Deng, Bo-Lin Chen, Wei-Qi Luo, Da Luo. Universal Image Steganalysis Based on Convolutional Neural Network with Global Covariance Pooling[J]. Journal of Computer Science and Technology, 2022, 37(5): 1134-1145. DOI: 10.1007/s11390-021-0572-0
    [3]Hua-Peng Wei, Ying-Ying Deng, Fan Tang, Xing-Jia Pan, Wei-Ming Dong. A Comparative Study of CNN- and Transformer-Based Visual Style Transfer[J]. Journal of Computer Science and Technology, 2022, 37(3): 601-614. DOI: 10.1007/s11390-022-2140-7
    [4]Zhang-Jin Huang, Xiang-Xiang He, Fang-Jun Wang, Qing Shen. A Real-Time Multi-Stage Architecture for Pose Estimation of Zebrafish Head with Convolutional Neural Networks[J]. Journal of Computer Science and Technology, 2021, 36(2): 434-444. DOI: 10.1007/s11390-021-9599-5
    [5]Jin-Gong Jia, Yuan-Feng Zhou, Xing-Wei Hao, Feng Li, Christian Desrosiers, Cai-Ming Zhang. Two-Stream Temporal Convolutional Networks for Skeleton-Based Human Action Recognition[J]. Journal of Computer Science and Technology, 2020, 35(3): 538-550. DOI: 10.1007/s11390-020-0405-6
    [6]Robail Yasrab. SRNET: A Shallow Skip Connection Based Convolutional Neural Network Design for Resolving Singularities[J]. Journal of Computer Science and Technology, 2019, 34(4): 924-938. DOI: 10.1007/s11390-019-1950-8
    [7]Dong-Di Zhao, Fan Li, Kashif Sharif, Guang-Min Xia, Yu Wang. Space Efficient Quantization for Deep Convolutional Neural Networks[J]. Journal of Computer Science and Technology, 2019, 34(2): 305-317. DOI: 10.1007/s11390-019-1912-1
    [8]Bei-Ji Zou, Yun-Di Guo, Qi He, Ping-Bo Ouyang, Ke Liu, Zai-Liang Chen. 3D Filtering by Block Matching and Convolutional Neural Network for Image Denoising[J]. Journal of Computer Science and Technology, 2018, 33(4): 838-848. DOI: 10.1007/s11390-018-1859-7
    [9]Xi-Jin Zhang, Yi-Fan Lu, Song-Hai Zhang. Multi-Task Learning for Food Identification and Analysis with Deep Convolutional Neural Networks[J]. Journal of Computer Science and Technology, 2016, 31(3): 489-500. DOI: 10.1007/s11390-016-1642-6
    [10]Zhang Zhong. Simulation of ATPG Neural Network and Its Experimental Results[J]. Journal of Computer Science and Technology, 1995, 10(4): 310-324.
    • Supplements (2)

  • Others

  • Cited by

    Periodical cited type(29)

    1. Yifang Chen, Weiwu Yin, Anwei Luo, et al. Improving the Generalization and Robustness of Computer‐Generated Image Detection Based on Contrastive Learning. International Journal of Intelligent Systems, 2025, 2025(1) DOI:10.1155/int/9939096
    2. Weize Quan, Pengfei Deng, Kai Wang, et al. CGFormer: ViT-Based Network for Identifying Computer-Generated Images With Token Labeling. IEEE Transactions on Information Forensics and Security, 2024, 19: 235. DOI:10.1109/TIFS.2023.3322083
    3. Georgios Karantaidis, Constantine Kotropoulos. Detect with Style: A Contrastive Learning Framework for Detecting Computer-Generated Images. Information, 2024, 15(3): 158. DOI:10.3390/info15030158
    4. Qiang Xu, Shan Jia, Xinghao Jiang, et al. MDTL-NET: Computer-generated image detection based on multi-scale deep texture learning. Expert Systems with Applications, 2024, 248: 123368. DOI:10.1016/j.eswa.2024.123368
    5. Qiang Xu, Xinghao Jiang, Tanfeng Sun, et al. Detecting Artificial Intelligence-Generated images via deep trace representations and interactive feature fusion. Information Fusion, 2024, 112: 102578. DOI:10.1016/j.inffus.2024.102578
    6. Qiang Xu, Dongmei Xu, Hao Wang, et al. Color Patterns And Enhanced Texture Learning For Detecting Computer-Generated Images. The Computer Journal, 2024, 67(6): 2303. DOI:10.1093/comjnl/bxae007
    7. Gajanan K. Birajdar, Mukesh D. Patil. A Systematic Survey on Photorealistic Computer Graphic and Photographic Image Discrimination. International Journal of Image and Graphics, 2023, 23(04) DOI:10.1142/S0219467823500377
    8. Qiang Xu, Hao Wang, Laijin Meng, et al. Exposing fake images generated by text-to-image diffusion models. Pattern Recognition Letters, 2023, 176: 76. DOI:10.1016/j.patrec.2023.10.021
    9. Preeti Sharma, Manoj Kumar, Hitesh Sharma. Comprehensive analyses of image forgery detection methods from traditional to deep learning approaches: an evaluation. Multimedia Tools and Applications, 2023, 82(12): 18117. DOI:10.1007/s11042-022-13808-w
    10. Kai Wang. Self-Supervised Learning for the Distinction between Computer-Graphics Images and Natural Images. Applied Sciences, 2023, 13(3): 1887. DOI:10.3390/app13031887
    11. Ye Yao, Shuhui Liu, Hui Wang, et al. An Improved Self-Training Model with Fine-Tuning Teacher/Student Exchange Strategy to Detect Computer-Generated Images. Security and Communication Networks, 2022, 2022: 1. DOI:10.1155/2022/3493336
    12. Pei Zheng, Hongyan Cong, Muhammad Arif. Visual Sensing Technology for Digital Image-Oriented Public Art Design. Security and Communication Networks, 2022, 2022: 1. DOI:10.1155/2022/6480172
    13. Zhize Wu, Huanyi Li, Xiaofeng Wang, et al. New Benchmark for Household Garbage Image Recognition. Tsinghua Science and Technology, 2022, 27(5): 793. DOI:10.26599/TST.2021.9010072
    14. Alluvenkateswara Rao, Chanamallu Srinivasa Rao, Dharma Raj Cheruku. Differentiating digital image forensics and tampering localization by a novel hybrid approach. Multimedia Tools and Applications, 2022, 81(13): 18693. DOI:10.1007/s11042-022-12257-9
    15. Ye Yao, Zhuxi Zhang, Xuan Ni, et al. CGNet: Detecting computer-generated images based on transfer learning with attention module. Signal Processing: Image Communication, 2022, 105: 116692. DOI:10.1016/j.image.2022.116692
    16. Kunj Bihari Meena, Vipin Tyagi. Distinguishing computer-generated images from photographic images using two-stream convolutional neural network. Applied Soft Computing, 2021, 100: 107025. DOI:10.1016/j.asoc.2020.107025
    17. Weiming Bai, Zhipeng Zhang, Bing Li, et al. Robust Texture-Aware Computer-Generated Image Forensic: Benchmark and Algorithm. IEEE Transactions on Image Processing, 2021, 30: 8439. DOI:10.1109/TIP.2021.3114989
    18. Ivan Castillo Camacho, Kai Wang. A Comprehensive Review of Deep-Learning-Based Methods for Image Forensics. Journal of Imaging, 2021, 7(4): 69. DOI:10.3390/jimaging7040069
    19. R. Asokan, T. Vijayakumar. Design of WhatsApp Image Folder Categorization Using CNN Method in the Android Domain. Journal of Ubiquitous Computing and Communication Technologies, 2021, 3(3): 180. DOI:10.36548/jucct.2021.3.003
    20. Weize Quan, Kai Wang, Dong-Ming Yan, et al. Learn with diversity and from harder samples: Improving the generalization of CNN-Based detection of computer-generated images. Forensic Science International: Digital Investigation, 2020, 35: 301023. DOI:10.1016/j.fsidi.2020.301023
    21. Peisong He, Haoliang Li, Hongxia Wang, et al. Detection of Computer Graphics Using Attention-Based Dual-Branch Convolutional Neural Network from Fused Color Components. Sensors, 2020, 20(17): 4743. DOI:10.3390/s20174743
    22. Qiang Xu, Zhe Wang, Zhongjie Mi, et al. Exposing Computer-Generated Images Via Amplified Texture Differences Learning. 2023 IEEE International Conference on Systems, Man, and Cybernetics (SMC), DOI:10.1109/SMC53992.2023.10394157
    23. Yanli Zou. 2021 International Conference on Big Data Analytics for Cyber-Physical System in Smart City. Lecture Notes on Data Engineering and Communications Technologies, DOI:10.1007/978-981-16-7466-2_123
    24. Nan Zhu, Zhiqin Liu, Xiaolu Guo, et al. Identifying recaptured images using deep hybrid correlation network. Fourteenth International Conference on Digital Image Processing (ICDIP 2022), DOI:10.1117/12.2643013
    25. Nan Zhu, Hanchen Xiang, Zhiqin Liu. Exposing Recaptured Images with Constrained Convolutional Neural Network. 2022 7th International Conference on Signal and Image Processing (ICSIP), DOI:10.1109/ICSIP55141.2022.9887337
    26. Ziyi Xi, Wenmin Huang, Kangkang Wei, et al. AI-Generated Image Detection using a Cross-Attention Enhanced Dual-Stream Network. 2023 Asia Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), DOI:10.1109/APSIPAASC58517.2023.10317126
    27. Alpana Singh, Krishna Raghav Chaturvedi, Tushar Sharma. Computational Modeling and Sustainable Energy. Innovations in Sustainable Technologies and Computing, DOI:10.1007/978-981-97-6794-6_32
    28. Ashutosh Pandey, Pritee Parwekar, Ashish Kumar Chakraverti. A Review On Deep Learning Techniques For Image Forgery Detection. 2022 International Conference on Computing, Communication, and Intelligent Systems (ICCCIS), DOI:10.1109/ICCCIS56430.2022.10037746
    29. Yifang Chen, Guanchen Wen, Yong Wang, et al. Security and Privacy in New Computing Environments. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, DOI:10.1007/978-3-031-73699-5_22

    Other cited types(0)

Catalog

    Get Citation
    PDF
    XML
    Read Online
    Article views (241) PDF downloads (0) Cited by(29)
    Related

    Copyright ©2025 JCST, All Rights Reserved     京ICP备05002829号-1

    Institute of Computing Technology, Chinese Academy of Sciences
    P.O. Box 2704, Beijing 100190, P.R. China

    Tel.: 86-10-62610746 E-mail: jcst@ict.ac.cn

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return