We use cookies to improve your experience with our site.

Indexed in:

SCIE, EI, Scopus, INSPEC, DBLP, CSCD, etc.

Submission System
(Author / Reviewer / Editor)
Yun-Yun Wang, Jian-Min Gu, Chao Wang, Song-Can Chen, Hui Xue. Discrimination-Aware Domain Adversarial Neural Network[J]. Journal of Computer Science and Technology, 2020, 35(2): 259-267. DOI: 10.1007/s11390-020-9969-4
Citation: Yun-Yun Wang, Jian-Min Gu, Chao Wang, Song-Can Chen, Hui Xue. Discrimination-Aware Domain Adversarial Neural Network[J]. Journal of Computer Science and Technology, 2020, 35(2): 259-267. DOI: 10.1007/s11390-020-9969-4

Discrimination-Aware Domain Adversarial Neural Network

Funds: The work was supported by the National Natural Science Foundation of China under Grant Nos. 61876091 and 61772284, the China Postdoctoral Science Foundation under Grant No. 2019M651918, and the Open Foundation of Key Laboratory of Pattern Analysis and Machine Intelligence of Ministry of Industry and Information Technology of China.
More Information
  • Author Bio:

    Yun-Yun Wang received her Ph.D. degree in computer science and technology from Nanjing University of Aeronautics and Astronautics, Nanjing, in 2012. She is currently with the College of Computer Science and Technology in Nanjing University of Posts and Telecommunications. Her current research interests include pattern recognition, machine learning and neural computing.

  • Received Date: August 19, 2019
  • Revised Date: January 01, 2020
  • Published Date: March 04, 2020
  • The domain adversarial neural network (DANN) methods have been successfully proposed and attracted much attention recently. In DANNs, a discriminator is trained to discriminate the domain labels of features generated by a generator, whereas the generator attempts to confuse it such that the distributions between domains are aligned. As a result, it actually encourages the whole alignment or transfer between domains, while the inter-class discriminative information across domains is not considered. In this paper, we present a Discrimination-Aware Domain Adversarial Neural Network (DA2NN) method to introduce the discriminative information or the discrepancy of inter-class instances across domains into deep domain adaptation. DA2NN considers both the alignment within the same class and the separation among different classes across domains in knowledge transfer via multiple discriminators. Empirical results show that DA2NN can achieve better classification performance compared with the DANN methods.
  • [1]
    Mansour Y, Mohri M, Rostamizadeh A. Domain adaptation:Learning bounds and algorithms. In Proc. the 22nd Annual Conference on Learning Theory, Jun. 2009, Article No. 3.
    [2]
    Özbulak G, Aytar Y, Ekenel H K. How transferable are CNN-based features for age and gender classification? In Proc. the 15th International Conference of the Biometrics Special Interest Group, Sept. 2016, pp.39-50.
    [3]
    Pan S J, Yang Q, Engineering D. A survey on transfer learning. IEEE Transactions on Knowledge Data Engineering, 2010, 22(10):1345-1359.
    [4]
    Long M, Cao Y, Wang J. Learning transferable features with deep adaptation networks. In Proc. the 32nd International Conference on Machine Learning, July 2015, pp.97-105.
    [5]
    Long M, Zhu H, Wang J, Jordan M I. Deep transfer learning with joint adaptation networks. In Proc. the 34th International Conference on Machine Learning, Aug. 2017, pp.2208-2217.
    [6]
    Ganin Y, Ustinova E, Ajakan H et al. Domain-adversarial training of neural networks. Journal of Machine Learning Research, 2016, 17:Article No. 59.
    [7]
    Tzeng E, Hoffman J, Darrell T et al. Simultaneous deep transfer across domains and tasks. In Proc. the 2015 IEEE International Conference on Computer Vision, Dec. 2015, pp.4068-4076.
    [8]
    Pei Z, Cao Z, Long M et al. Multi-adversarial domain adaptation. In Proc. the 32nd AAAI Conference on Artificial Intelligence, Feb. 2018, pp.3934-3941.
    [9]
    Tzeng E, Hoffman J, Saenko K et al. Adversarial discriminative domain adaptation. In Proc. the 2017 IEEE Conference on Computer Vision & Pattern Recognition, July 2017, pp.2962-2971.
    [10]
    Tzeng E, Hoffman J, Zhang N et al. Deep domain confusion:Maximizing for domain invariance. arXiv:1412.3474, 2014. https://arxiv.org/pdf/1412.3474.pdf,Nov.2019.
    [11]
    Baktashmotlagh M, Harandi M T, Lovell B C et al. Unsupervised domain adaptation by domain invariant projection. In Proc. the 2013 IEEE International Conference on Computer Vision, Dec. 2013, pp.769-776.
    [12]
    Wang J, Chen Y, Hao S et al. Balanced distribution adaptation for transfer learning. In Proc. the 17th IEEE International Conference on Data Mining, Nov. 2017, pp.1129-1134.
    [13]
    Liang J, He R, Sun Z et al. Aggregating randomized clustering-promoting invariant projections for domain adaptation. IEEE Trans. Pattern Anal. Mach. Intell., 2019, 41(5):1027-1042.
    [14]
    Long M, Zhu H, Wang J, Jordan M I. Unsupervised domain adaptation with residual transfer networks. In Proc. the 30th Neural Information Processing Systems, Dec. 2016, pp.136-144.
    [15]
    Sohn K, Shang W, Yu X et al. Unsupervised domain adaptation for distance metric learning. In Proc. the 7th International Conference on Learning Representations, May 2019.
    [16]
    Pan S J, Tsang I W, Kwok J T et al. Domain adaptation via transfer component analysis. IEEE Transactions on Neural Networks, 2011, 22(2):199-210.
    [17]
    Long M, Wang J, Ding G et al. Transfer feature learning with joint distribution adaptation. In Proc. the 2014 IEEE International Conference on Computer Vision, Sept. 2014, pp.2200-2207.
    [18]
    Ben-David S, Blitzer J, Crammer K et al. Analysis of representations for domain adaptation. In Proc. the 20th International Conference on Neural Information Processing Systems, Dec. 2006, pp.137-144.
    [19]
    Fernando B, Habrard A, Sebban M et al. Unsupervised visual domain adaptation using subspace alignment. In Proc. the 2013 IEEE International Conference on Computer Vision, Dec. 2013, pp.2960-2967.
    [20]
    Jing Z, Li W, Ogunbona P. Joint geometrical and statistical alignment for visual domain adaptation. In Proc. the 2017 IEEE Conference on Computer Vision & Pattern Recognition, July 2017, pp.5150-5158.
    [21]
    Krizhevsky A, Sutskever I, Hinton G E. ImageNet classification with deep convolutional neural networks. In Proc. the 26th Annual Conference on Neural Information Processing Systems, Dec. 2012, pp.1106-1114.
    [22]
    Ghifary M, Kleijn W B, Zhang M. Domain adaptive neural networks for object recognition. In Proc. the 13th Pacific Rim International Conference on Artificial Intelligence, Dec. 2014, pp.898-904.
    [23]
    Yu C, Wang J, Chen Y et al. Transfer learning with dynamic adversarial adaptation network. In Proc. the 19th IEEE International Conference on Data Mining, Nov. 2019.
    [24]
    Saenko K, Kulis B, Fritz M et al. Adapting visual category models to new domains. In Proc. the 11th European Conference on Computer Vision, Sept. 2010, pp.213-226.
    [25]
    Gong B, Yuan S, Fei S et al. Geodesic flow kernel for unsupervised domain adaptation. In Proc. the 25th IEEE Conference on Computer Vision & Pattern Recognition, Jun. 2012, pp.2066-2073.
    [26]
    Gretton A, Borgwardt K M, Rasch M et al. A kernel twosample test. Journal of Machine Learning Research, 2012, 13(1):723-773.
    [27]
    Jia Y, Shelhamer E, Donahue J et al. Caffe:Convolutional architecture for fast feature embedding. In Proc. the 22nd ACM International Conference on Multimedia, Apr. 2014, pp.675-678.
    [28]
    Donahue J, Jia Y, Vinyals O et al. DeCAF:A deep convolutional activation feature for generic visual recognition. In Proc. the 31st International Conference on International Conference on Machine Learning, Jun. 2014, pp.647-655.
  • Related Articles

    [1]Shu-Yu Guo, Lan Huang, Yu-Hao Mu, Tian Bai. Unsupervised Adversarial Domain Adaptation with Hierarchical Semantic Consistency for Cross-Modal Nuclei Detection[J]. Journal of Computer Science and Technology, 2025, 40(3): 780-791. DOI: 10.1007/s11390-025-4324-4
    [2]Ming-Cong Ma, Lu Wang, Yan-Ning Xu, Xiang-Xu Meng. Unsupervised Reconstruction for Gradient-Domain Rendering with Illumination Separation[J]. Journal of Computer Science and Technology, 2024, 39(6): 1281-1291. DOI: 10.1007/s11390-024-3142-4
    [3]Hong-Jie Zhang, Ang Li, Jie Guo, Yan-Wen Guo. Improving Open Set Domain Adaptation Using Image-to-Image Translation and Instance-Weighted Adversarial Learning[J]. Journal of Computer Science and Technology, 2023, 38(3): 644-658. DOI: 10.1007/s11390-021-1073-x
    [4]Qing Tian, Chuang Ma, Feng-Yuan Zhang, Shun Peng, Hui Xue. Source-Free Unsupervised Domain Adaptation with Sample Transport Learning[J]. Journal of Computer Science and Technology, 2021, 36(3): 606-616. DOI: 10.1007/s11390-021-1106-5
    [5]Fu-Zhen Zhuang, Ying-Min Zhou, Hao-Chao Ying, Fu-Zheng Zhang, Xiang Ao, Xing Xie, Qing He, Hui Xiong. Sequential Recommendation via Cross-Domain Novelty Seeking Trait Mining[J]. Journal of Computer Science and Technology, 2020, 35(2): 305-319. DOI: 10.1007/s11390-020-9945-z
    [6]Jun Yin, Wayne Xin Zhao, Xiao-Ming Li. Type-Aware Question Answering over Knowledge Base with Attention-Based Tree-Structured Neural Networks[J]. Journal of Computer Science and Technology, 2017, 32(4): 805-813. DOI: 10.1007/s11390-017-1761-8
    [7]Fernando Matos, Alexandre Matos, Paulo Sim&otildees, Edmundo Monteiro. Provisioning of Inter-Domain QoS-Aware Services[J]. Journal of Computer Science and Technology, 2015, 30(2): 404-420. DOI: 10.1007/s11390-015-1532-3
    [8]Fatemeh Dorri, Ali Ghodsi. Minimizing the Discrepancy Between Source and Target Domains by Learning Adapting Components[J]. Journal of Computer Science and Technology, 2014, 29(1): 105-115. DOI: 10.1007/s11390-013-1415-4
    [9]Wei-Wei Xu, Kun Zhou. Gradient Domain Mesh Deformation - A Survey[J]. Journal of Computer Science and Technology, 2009, 24(1): 6-18.
    [10]Wang Haiying, Liu Shenquan. A Domain Knowledge Driven Approach for User Interface Software Development[J]. Journal of Computer Science and Technology, 1991, 6(2): 145-152.
  • Others

  • Cited by

    Periodical cited type(6)

    1. Mona Moradi, Mohammad Rahmanimanesh, Ali Shahzadi. Learning from streaming data with unsupervised heterogeneous domain adaptation. International Journal of Data Science and Analytics, 2023. DOI:10.1007/s41060-023-00463-z
    2. Gui-Rong Bai, Qing-Bin Liu, Shi-Zhu He, et al. Unsupervised Domain Adaptation on Sentence Matching Through Self-Supervision. Journal of Computer Science and Technology, 2023, 38(6): 1237. DOI:10.1007/s11390-022-1479-0
    3. Sen Wang, Yun Lin, Ming Hao, et al. Assessment of speech communication interference effects under small sample conditions. Wireless Networks, 2023, 29(7): 2909. DOI:10.1007/s11276-023-03396-4
    4. Hong-Jie Zhang, Ang Li, Jie Guo, et al. Improving Open Set Domain Adaptation Using Image-to-Image Translation and Instance-Weighted Adversarial Learning. Journal of Computer Science and Technology, 2023, 38(3): 644. DOI:10.1007/s11390-021-1073-x
    5. Huaiyuan Qi, Yinghua Han, Siwei Tuo, et al. Fault Diagnosis in Wind Turbines Based on Weighted Joint Domain Adversarial Network Under Various Working Conditions. IEEE Sensors Journal, 2023, 23(13): 15165. DOI:10.1109/JSEN.2023.3279290
    6. Yunyun Wang, Chao Wang, Hui Xue, et al. Self-corrected unsupervised domain adaptation. Frontiers of Computer Science, 2022, 16(5) DOI:10.1007/s11704-021-1010-8

    Other cited types(0)

Catalog

    Article views (94) PDF downloads (374) Cited by(6)
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return