We use cookies to improve your experience with our site.

Indexed in:

SCIE, EI, Scopus, INSPEC, DBLP, CSCD, etc.

Submission System
(Author / Reviewer / Editor)
Advanced Search
Volume 34 Issue 3
May  2019
Turn off MathJax
Article Contents
Abstract
References
Related Articles
Supplements
Han Liu, Hang Du, Dan Zeng, Qi Tian. Cloud Detection Using Super Pixel Classification and Semantic Segmentation[J]. Journal of Computer Science and Technology, 2019, 34(3): 622-633. DOI: 10.1007/s11390-019-1931-y
Citation: Han Liu, Hang Du, Dan Zeng, Qi Tian. Cloud Detection Using Super Pixel Classification and Semantic Segmentation[J]. Journal of Computer Science and Technology, 2019, 34(3): 622-633. DOI: 10.1007/s11390-019-1931-y
shu

Cloud Detection Using Super Pixel Classification and Semantic Segmentation

  • 1 Key Laboratory of Specialty Fiber Optics and Optical Access Networks, Shanghai University, Shanghai 200444, China;
    2 Shanghai Institute of Advanced Communication and Data Science, Shanghai University, Shanghai 200444, China;
    3 Department of Computer Science, The University of Texas at San Antonio, San Antonio, U.S.A.

Funds: This work was supported in part by ARO under Grant No. W911NF-15-1-0290 and Faculty Research Gift Awards by NEC Laboratories of America and Blippar to Dr. Qi Tian. It was also supported in part by the National Natural Science Foundation of China under Grant Nos. 61429201 and 61572307.
More Information
  • Author Bio:

    Han Liu received his B.E. degree in communication and information engineering from Shanghai University, Shanghai, in 2017. He is currently pursuing his M.E. degree at Key Laboratory of Specialty Fiber Optics and Optical Access Networks and Shanghai Institute of Advanced Communication and Data Science, Shanghai University, Shanghai. His research interests focus on computer vision and pattern recognition.

  • Corresponding author:

    Dan Zeng E-mail: dzeng@shu.edu.cn

  • Received Date: October 18, 2018
  • Revised Date: March 26, 2019
  • Published Date: May 04, 2019
    Abstract
  • Cloud detection plays a very significant role in remote sensing image processing. This paper introduces a cloud detection method based on super pixel level classification and semantic segmentation. Firstly, remote sensing images are segmented into super pixels. Segmented super pixels compose a super pixel level remote sensing image database. Though cloud detection is essentially a binary classification task, our database is labeled into four categories to improve the generalization ability:thick cloud, cirrus cloud, building, and other culture. Secondly, the super pixel level database is used to train our cloud detection models based on convolution neural network (CNN) and deep forest. Hierarchical fusion CNN is proposed considering super pixel level images contain less semantic information than normal images. Taking full advantage of low-level features like color and texture information, it is more applicable for super pixel level classification. Besides, a distance metric is proposed to refine ambiguous super pixels. Thirdly, an end-to-end cloud detection model based on semantic segmentation is introduced. This model has no restrictions on the input size, and takes less time. Experimental results show that compared with other cloud detection methods, our proposed method achieves better performance.
    • FullText(HTML)
    • References (27)
  • [1]
    Xie F, Shi M, Shi Z, Yin J, Zhao D. Multilevel cloud detection in remote sensing images based on deep learning. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2017, 10(8):3631-3640.
    [2]
    Shi M, Xie F, Zi Y, Yin J. Cloud detection of remote sensing images by deep learning. In Proc. the 2016 IEEE International Geoscience and Remote Sensing Symposium, July 2016, pp.701-704.
    [3]
    Liu H, Zeng D, Tian Q. Super pixel cloud detection using hierarchical fusion CNN. In Proc. the 4th IEEE International Conference on Multimedia Big Data, September 2018, Article No. 32.
    [4]
    Zhou Z H, Feng J. Deep forest:Towards an alternative to deep neural networks. arXiv:1702.08835, 2017. https://arxiv.org/abs/1702.08835, May 2018.
    [5]
    Jedlovec G J, Haines S L, LaFontaine F J. Spatial and temporal varying thresholds for cloud detection in GOES imagery. IEEE Transactions on Geoscience and Remote Sensing, 2008, 46(6):1705-1717.
    [6]
    Zhang Q, Xiao C. Cloud detection of RGB color aerial photographs by progressive refinement scheme. IEEE Transactions on Geoscience and Remote Sensing, 2014, 52(11):7264-7275.
    [7]
    Zhong B, Chen W, Wu S, Hu L, Luo X, Liu Q. A cloud detection method based on relationship between objects of cloud and cloud-shadow for Chinese moderate to high resolution satellite imagery. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2017, 10(11):4898-4908.
    [8]
    Li Z, Shen H, Li H, Xia G, Gamba P, Zhang L. Multi-feature combined cloud and cloud shadow detection in GaoFen-1 wide field of view imagery. Remote Sensing of Environment, 2017, 191:342-358.
    [9]
    Visa A, Valkealahti K, Simula O. Cloud detection based on texture segmentation by neural network methods. In Proc. the 1991 IEEE International Joint Conference on Neural Networks, Vol. 2, November 1991, pp.1001-1006.
    [10]
    Zhan Y, Wang J, Shi J, Cheng G, Yao L, Sun W. Distinguishing cloud and snow in satellite images via deep convolutional network. IEEE Geoscience and Remote Sensing Letters, 2017, 14(10):1785-1789.
    [11]
    Achanta R, Shaji A, Smith K, Lucchi A, Fua P, Süsstrunk S. SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2012, 34(11):2274-2282.
    [12]
    Hu X, Wang Y, Shan J. Automatic recognition of cloud images by using visual saliency features. IEEE Geosci. Remote Sensing Lett., 2015, 12(8):1760-1764.
    [13]
    Tan K, Zhang Y, Tong X. Cloud extraction from Chinese high resolution satellite imagery by probabilistic latent semantic analysis and object-based machine learning. Remote Sensing, 2016, 8(11):Article No. 963.
    [14]
    Yuan Y, Hu X. Bag-of-words and object-based classification for cloud extraction from satellite imagery. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2015, 8(8):4197-4205.
    [15]
    Li Z, Shen H, Wei Y, Cheng Q, Yuan Q. Cloud detection by fusing multi-scale convolutional features. In Proc. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Science, May 2018, pp.149-152.
    [16]
    Ma C, Luo G, Wang K. Concatenated and connected random forests with multiscale patch driven active contour model for automated brain tumor segmentation of MR images. IEEE Transactions on Medical Imaging, 2018, 37(8):1943-1954.
    [17]
    Zhang C, Yan J, Li C, Bie R. Contour detection via stacking random forest learning. Neurocomputing, 2018, 275:2702- 2715.
    [18]
    Shen Y, Lu H, Jia J. Classification of motor imagery EEG signals with deep learning models. In Proc. the 7th International Conference on Intelligent Science and Big Data Engineering, September 2017, pp.181-190.
    [19]
    Dollár P, Zitnick C L. Fast edge detection using structured forests. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2015, 37(8):1558-1570.
    [20]
    van den Bergh M, Boix X, Roig G, van Gool L. SEEDS:Superpixels extracted via energy-driven sampling. International Journal of Computer Vision, 2015, 111(3):298-314.
    [21]
    Krizhevsky A. Learning multiple layers of features from tiny images. Technical Report, University of Toronto, 2009. http://www.cs.toronto.edu/～kriz/learning-features- 2009-TR.pdf, March 2019.
    [22]
    Lin T Y, Dollár P, Girshick R B, He K, Hariharan B, Belongie S. Feature pyramid networks for object detection. In Proc. the 2017 IEEE Conference on Computer Vision and Pattern Recognition, July 2017, pp.936-944.
    [23]
    Chen L C, Zhu Y, Papandreou G, Schroff F, Adam H. Encoder-decoder with atrous separable convolution for semantic image segmentation. arXiv:1802.02611, 2018. https://arxiv.org/abs/1802.02611, March 2019.
    [24]
    Chen L C, Papandreou G, Schroff F, Adam H. Rethinking atrous convolution for semantic image segmentation. arXiv:1706.05587, 2017. https://arxiv.org/abs/1706.05587, March 2019.
    [25]
    Chollet F. Xception:Deep learning with depthwise separable convolutions. arXiv:1610.02357, 2016. https://arxiv.org/abs/1610.02357, March 2019.
    [26]
    Jia Y, Shelhamer E, Donahue J, Karayev S, Long J, Girshick R, Guadarrama S, Darrell T. Caffe:Convolutional architecture for fast feature embedding. In Proc. the 22nd ACM International Conference on Multimedia, November 2014, pp.675-678.
    [27]
    Tang M, Gorelick L, Veksler O, Boykov Y. GrabCut in one cut. In Proc. the 2013 IEEE International Conference on Computer Vision, December 2013, pp.1769-1776.
    • Relative Articles

  • Related Articles

    [1]Hui Xu, Pan Qi, Fu-Xin Tang, Hua-Guo Liang, Zheng-Feng Huang. SegNet-OPC: A Mask Optimization Framework in VLSI Design Flow Based on Semantic Segmentation Network[J]. Journal of Computer Science and Technology, 2025, 40(2): 500-512. DOI: 10.1007/s11390-023-3002-7
    [2]Cheng-Li Peng, Jia-Yi Ma. Real-Time Semantic Segmentation via an Efficient Multi-Column Network[J]. Journal of Computer Science and Technology, 2022, 37(6): 1478-1491. DOI: 10.1007/s11390-022-0888-4
    [3]MENG Xiaofeng, LIU Shuang, WANG Shan. Word Segmentation Based on Database Semanticsin NChiql[J]. Journal of Computer Science and Technology, 2000, 15(4): 346-354.
    [4]TING Jing'an. A Neural Paradigm for Time-Varying Motion Segmentation[J]. Journal of Computer Science and Technology, 1999, 14(6): 539-550.
    [5]NI Bin, FENG Yulin. Dynamic Checking Frameworkfor Java Beaus Semantic Constraints[J]. Journal of Computer Science and Technology, 1999, 14(4): 408-413.
    [6]Ma Feng, Xia Shaowei. A Multiscale Approach to Automatic Medical Image Segmentation Using Self-Organizing Map[J]. Journal of Computer Science and Technology, 1998, 13(5): 402-409.
    [7]Gao Jingbo, Li Xinyou, Tang Zesheng. Segmentation of Stick Text Based on Sub Connected Area Analysis[J]. Journal of Computer Science and Technology, 1998, 13(1): 55-62.
    [8]Zheng Nanning, Liu Jianqin. Visual Knowledge Representation and Intelligent Image Segmentation[J]. Journal of Computer Science and Technology, 1992, 7(3): 219-225.
    [9]Liu Tong, C.S.Tang. Semantic Specification and Verification of Data Flow Diagrams[J]. Journal of Computer Science and Technology, 1991, 6(1): 21-31.
    [10]Ye Daxing. Three Improvements on an Incremental Algorithm for Automatic Semantic Analysis[J]. Journal of Computer Science and Technology, 1989, 4(1): 67-74.
    • Supplements (1)

  • Others

  • Cited by

    Periodical cited type(12)

    1. Weiwu Ye, Shihong Li. Digital protection analysis of national traditional sports health cultural heritage based on big data in the era of data cloud. Multimedia Tools and Applications, 2024. DOI:10.1007/s11042-024-18371-0
    2. Bo Jiang, Haozhan Chong, Zhenyu Tan, et al. FDT-Net: Deep-Learning Network for Thin-Cloud Removal in Remote Sensing Image Using Frequency-Domain Training Strategy. IEEE Geoscience and Remote Sensing Letters, 2024, 21: 1. DOI:10.1109/LGRS.2024.3389995
    3. Chaojun Shi, Zibo Su, Ke Zhang, et al. CloudFU-Net: A Fine-Grained Segmentation Method for Ground-Based Cloud Images Based on an Improved Encoder–Decoder Structure. IEEE Transactions on Geoscience and Remote Sensing, 2024, 62: 1. DOI:10.1109/TGRS.2024.3389089
    4. Cheng-Li Peng, Jia-Yi Ma. Real-Time Semantic Segmentation via an Efficient Multi-Column Network. Journal of Computer Science and Technology, 2022, 37(6): 1478. DOI:10.1007/s11390-022-0888-4
    5. Min Ling, Qun Cheng, Jun Peng, et al. Image Semantic Segmentation Method Based on Deep Learning in UAV Aerial Remote Sensing Image. Mathematical Problems in Engineering, 2022, 2022: 1. DOI:10.1155/2022/5983045
    6. Lingling Fang, Xin Wang, Ziyi Lian, et al. Supervoxel-based brain tumor segmentation with multimodal MRI images. Signal, Image and Video Processing, 2022, 16(5): 1215. DOI:10.1007/s11760-021-02072-4
    7. Qi Hao, Wenguang Zheng, Yingyuan Xiao. Fusion Information Multi-View Classification Method for Remote Sensing Cloud Detection. Applied Sciences, 2022, 12(14): 7295. DOI:10.3390/app12147295
    8. Jinhua Wu, Yunfei Jiang, Fang Deng, et al. Intelligent Control System of Unmanned Vehicle Based on CAN Controller. Advances in Multimedia, 2022, 2022: 1. DOI:10.1155/2022/7448905
    9. Xue-Guang Wang, Ming Li, Lei Zhang, et al. A New Method on Super Pixel Reducing Stereo Matching Time of Integrated Imaging. International Journal of Pattern Recognition and Artificial Intelligence, 2021, 35(04): 2154014. DOI:10.1142/S0218001421540148
    10. Hui Wang. Computer Image Processing Technology in Illustration Design. Journal of Physics: Conference Series, 2021, 2037(1): 012113. DOI:10.1088/1742-6596/2037/1/012113
    11. Wangbin Li, Kaimin Sun, Zhuotong Du, et al. PCNet: Cloud Detection in FY-3D True-Color Imagery Using Multi-Scale Pyramid Contextual Information. Remote Sensing, 2021, 13(18): 3670. DOI:10.3390/rs13183670
    12. Ning Fan. Application of Intelligent Systems in Multi-modal Information Analytics. Advances in Intelligent Systems and Computing, DOI:10.1007/978-3-030-51556-0_46

    Other cited types(0)

Catalog

    Get Citation
    PDF
    XML
    Article views (49) PDF downloads (401) Cited by(12)
    Related

    Copyright ©2025 JCST, All Rights Reserved     京ICP备05002829号-1

    Institute of Computing Technology, Chinese Academy of Sciences
    P.O. Box 2704, Beijing 100190, P.R. China

    Tel.: 86-10-62610746 E-mail: jcst@ict.ac.cn

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return