With the rapid advancements in AI-generated imagery, particularly diffusion-based models, detecting synthetic human faces has become increasingly challenging. In this paper, we introduce a synthetic face detection framework that leverages two complementary features: (i) UV textures extracted using 3D Morphable Models (3DMM) and (ii) surface frames capturing geometric structures. These modalities are fused using both feature-level and score-level fusion strategies to enhance generalization to unseen generators and robustness against post-processing operations. Experimental evaluations on diverse datasets demonstrate that our proposed method outperforms single-modality and CLIP-based approaches and provides improved generalization across different diffusion generative models, as well as improved robustness against common and strong processing operations.

3D Morphable Models Meet Surface Frames for Generalizable and Robust Deepfake Detection

Caldelli R.;
2025-01-01

Abstract

With the rapid advancements in AI-generated imagery, particularly diffusion-based models, detecting synthetic human faces has become increasingly challenging. In this paper, we introduce a synthetic face detection framework that leverages two complementary features: (i) UV textures extracted using 3D Morphable Models (3DMM) and (ii) surface frames capturing geometric structures. These modalities are fused using both feature-level and score-level fusion strategies to enhance generalization to unseen generators and robustness against post-processing operations. Experimental evaluations on diverse datasets demonstrate that our proposed method outperforms single-modality and CLIP-based approaches and provides improved generalization across different diffusion generative models, as well as improved robustness against common and strong processing operations.
2025
3D Morphable Models
Robust deepfake detection
Surface frame
Synthetic image detection
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.12606/46425
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
social impact