We use cookies to improve your experience with our site.

基于未知攻击的人脸防欺骗:特征提取与表示的综合视角

Face Anti-Spoofing with Unknown Attacks: A Comprehensive Feature Extraction and Representation Perspective

  • 摘要: 面部抗欺骗技术旨在检测输入是否是用户的真实照片(活体)还是伪造的(欺骗)图像。随着新型攻击手段不断出现,检测未知攻击的任务,即零样本面部抗欺骗(ZSFA),在学术界和工业界变得越来越重要。现有的ZSFA方法主要集中在提取欺骗和活体面部之间的区分性特征。然而,欺骗面部的本质是通过模仿活体来欺骗抗欺骗系统,因此被现有ZSFA方法忽视的已知攻击与活体之间的欺骗性特征对于全面表征活体至关重要。因此,现有的ZSFA模型无法学习到活体面部的完整表示,从而在有效检测新出现的攻击不足。为了解决这个问题,我们提出了一种新颖的特征提取框架,可以捕获活体和现有欺骗面部之间的欺骗性和区分性特征。该框架由一个可学习的掩蔽机制和一个二对一的训练方案组成。为了解决引入欺骗性特征后类别函数的失效问题以及不同特征维度之间的优势不平衡问题,我们采用了一个新修改的语义自编码器将所有提取的特征表示到一个语义空间,以平衡每个特征维度的优势。因此,我们的方法同时实现了对未知攻击的有效检测以及对已知欺骗的相对准确检测。实验结果证实了我们提出方法在识别活体方面的优越性和有效性,即使在已知和未知欺骗类型的干扰下也是如此。

     

    Abstract: Face anti-spoofing aims at detecting whether the input is a real photo of a user (living) or a fake (spoofing) image. As new types of attacks keep emerging, the detection of unknown attacks, known as Zero-Shot Face Anti-Spoofing (ZSFA), has become increasingly important in both academia and industry. Existing ZSFA methods mainly focus on extracting discriminative features between spoofing and living faces. However, the nature of the spoofing faces is to trick anti-spoofing systems by mimicking the livings, therefore the deceptive features between the known attacks and the livings, which have been ignored by existing ZSFA methods, are essential to comprehensively represent the livings. Therefore, existing ZSFA models are incapable of learning the complete representations of living faces and thus fall short of effectively detecting newly emerged attacks. To tackle this problem, we propose an innovative method that effectively captures both the deceptive and discriminative features distinguishing between genuine and spoofing faces. Our method consists of two main components: a two-against-all training strategy and a semantic autoencoder. The two-against-all training strategy is employed to separate deceptive and discriminative features. To address the subsequent invalidation issue of categorical functions and the dominance disequilibrium issue among different dimensions of features after importing deceptive features, we introduce a modified semantic autoencoder. This autoencoder is designed to map all extracted features to a semantic space, thereby achieving a balance in the dominance of each feature dimension. We combine our method with the feature extraction model ResNet50, and experimental results show that the trained ResNet50 model simultaneously achieves a feasible detection of unknown attacks and comparably accurate detection of known spoofing. Experimental results confirm the superiority and effectiveness of our proposed method in identifying the living with the interference of both known and unknown spoofing types.

     

/

返回文章
返回