After Deception: How Falling for a Deepfake Affects the Way We See, Hear, and Experience Media

Author(s)
Teresa Weikmann, Hannah Greber, Alina Nikolaou
Abstract

With the emergence of artificial intelligence, deepfakes have rendered it possible to manipulate anyone’s and anything’s audio-visual representation, adding fuel to the discussion about the believability of what we hear and see in the news. However, we do not know yet whether deepfakes can actually impact (1) the credibility attributed to audio-visual media in general, as well as (2) the perceived self-efficacy to discern between real and fake media. Furthermore, it remains unclear if different deepfake formats can affect citizens to differing degrees. This study employs a 3 × 2 × 2 between-within-subjects experiment (N = 951) with the between-subjects factor format (audio vs. video vs. 360°-video) and facticity (real vs. fake) and the within-subjects factor reveal (pre vs. post-reveal). We explore what happens after revealing to a sample of German participants that they have been deceived by a deepfake. Our findings show that credibility of media drops across all formats after revealing the stimulus was fake, whereas the control group is not affected. On the other hand, self-efficacy is impacted even for people who were exposed to authentic news media. This shows that deepfakes may have far-reaching societal implications that go beyond deception, whereas modality seems to matter little for such effects.

Organisation(s)
Department of Communication
Journal
International Journal of Press/Politics
Volume
30
Pages
187-210
No. of pages
24
ISSN
1940-1612
DOI
https://doi.org/10.1177/19401612241233539
Publication date
03-2024
Peer reviewed
Yes
Austrian Fields of Science 2012
508002 Audiovisual media, 508020 Political communication
Keywords
ASJC Scopus subject areas
Communication, Sociology and Political Science
Portal url
https://ucrisportal.univie.ac.at/en/publications/51da8f05-1c74-4c7f-9249-a15e3fc0be31