跳到主要导航 跳到搜索 跳到主要内容

FCD-Net: Learning to Detect Multiple Types of Homologous Deepfake Face Images

  • Ruidong Han
  • , Xiaofeng Wang
  • , Ningning Bai
  • , Qin Wang
  • , Zinian Liu
  • , Jianru Xue
  • Xi'an University of Technology
  • Yuncheng University

科研成果: 期刊稿件文章同行评审

34 引用 (Scopus)

摘要

With the rapid development of artificial intelligence technology, a variety of GAN generated deepfake face images/videos have emerged endlessly. The abuse of deepfake has brought serious negative effects to many industries. Therefore, there is an urgent need to develop advanced methods to combat the abuse of deepfake. As far as we know, there are almost no techniques that can distinguish multiple types of homologous deepfake face images. In this study, we propose a method based on the multi-classification task to address this issue. The proposed method relies on a novel network framework named FCD-Net that consists of the facial synaptic saliency module (FSS), the contour detail feature extraction module (CDFE), and the distinguishing feature fusion module (DFF). Utilizing this method, the imperceptible features introduced by deepfake can be exposed, and the differences caused by different types of deepfake can be distinguished, even if deepfake images are homologous. To test the proposed method and compare it with other SOTA methods, we establish a new homologous dataset named HDFD that contains real face images, entire face synthesis images, face swap images, and facial attribute manipulation images. Among them, the three types of deepfake images are all generated from the same real face images through different deepfake techniques. Abundant experiment results demonstrate that the proposed method has a high-level detection accuracy and relatively strong robustness against content-preserving manipulations. Moreover, the generalization of our method is superior to other SOTA methods.

源语言英语
页(从-至)2653-2666
页数14
期刊IEEE Transactions on Information Forensics and Security
18
DOI
出版状态已出版 - 2023

学术指纹

探究 'FCD-Net: Learning to Detect Multiple Types of Homologous Deepfake Face Images' 的科研主题。它们共同构成独一无二的学术指纹。

引用此