Audio deepfake

manipulation simulates real voice to portray someone saying something they did not say

Authors

  • Magaly Parreira do Prado University of São Paulo, School of Communications and Arts, São Paulo, São Paulo, Brazil

DOI:

https://doi.org/10.23925/1984-3585.2021i23p45-68

Keywords:

Deepfake, Audio deepfake, Artificial Intelligence, Algorithms

Abstract

“Audio deepfake” is a part of the complex of deepfake, which is a form of the fake news (FN) produced with the purpose of deceiving the unwary. The study aims at understanding how audio deepfake spreads and exerts an ascendancy over the public,
distorting their way of thinking through unknown algorithms. The idea is to point out how the relationship between the (usurped) data and the analysis and monitoring of the media takes place to “better” direct those who receive the various kinds of misinformation. The main hypothesis is that the lack of protection of our personal data turns them into the raw material for the indiscriminate use of fraudulent information. The power of the resources of Artificial Intelligence techniques is examined, and a list of tools to manufacture and detect them is set up. In scrutinizing audio deepfakes inserted or not in video deepfakes and the damage they cause in their uncontrolled dissemination, the paper analyzes a malicious case of voice cloning and manipulation camouflaged as a risk report. The challenge to the ethics of information is discussed.

Author Biography

Magaly Parreira do Prado, University of São Paulo, School of Communications and Arts, São Paulo, São Paulo, Brazil

Post-doctoral researcher at the Oscar Sala Chair at the Institute for Advanced Studies, University of São Paulo and at the School of Communications and Arts (ECA). She holds a PhD in Communication and Semiotics and a master's degree in Intelligence Technologies and Digital Design, both from Pontifícia Universidade Católica São Paulo (PUC-SP). She holds a bachelor's degree in Journalism and a graduate degree in Journalistic Communication from Faculdade Cásper Líbero.

References

BOTS. The Media Manipulation Casebook. Disponível em: mediamanipulation.org/definitions/bots. Acesso em: 12 jul. 2021.

BUCCI, Eugênio. Existe democracia sem verdade factual? São Paulo: Estação das Letras e Cores, 2019.

DEEP LEARNING é tecnologia de aprendizado de máquina que mais cresce em todo o mundo. 2 out. 2017. Disponível em: unicamp.br/unicamp/noticias/2017/10/02/deep-learning-e-tecnologia-deaprendizado-de-maquina-que-mais-cresce-em-todo-o. Acesso em: 17 jul. 2021.

FRANCESCHI-BICCHIERAI, Lorenzo. 2020. Listen to This Deepfake Audio Impersonating a CEO in Brazen Fraud Attempt. 23 jul. 2020. Motherboard/Vice, 23 jul. 2020. Disponível em: vice.com/en/article/pkyqvb/deepfake-audio-impersonating-ceo-fraud-attempt. Acesso em 17jul. 2021.

GOGONI, Ronaldo. O que é deep fake e porque você deveria se preocupar com isso. Tecnoblog, 18 out. 2018. Disponível em: tecnoblog.net/264153/o-que-e-deep-fake-e-porque-voce-deveria-se-preocupar-comisso. Acesso em: 13 jul. 2021.

HAI – HUMAN-CENTERED ARTIFICIAL INTELLIGENCE, STANFORD UNIVERSITY. Artificial Intelligence Index Report 2021. Palo Alto, CA, 2021. Disponível em: aiindex.stanford.edu/wp-content/uploads/2021/03/2021-AI-Index-Report_Master.pdf. Acesso em: 15 jul. 2021.

HAMELEERS, Michael et al. A Picture Paints a Thousand Lies? The Effects and Mechanisms of Multimodal Disinformation and Rebuttals Disseminated. Social Media, Political Communication, v. 37, n. 2, p. 281-301, 2020.

HAO, Karen. How Facebook got addicted to spreading misinformation. MIT Technology Review, 11 mar. 2021. Disponível em: technologyreview. com/2021/03/11/1020600/facebook-responsible-ai-misinformation. Acesso em: 12 jul. 2021.

HARWELL, Drew. An artificial-intelligence first: Voice-mimicking software reportedly used in a major theft. The Washington Post, 4 set. 2019. Disponível em: washingtonpost.com/technology/2019/09/04/ an-artificial-intelligence-first-voice-mimicking-software-reportedly-usedmajor-theft. Acesso em: 14 jul. 2021.

JIN, Zeyu et al. Voco: text-based insertion and replacement in audio narration. ACM Transactions on Graphics, v. 36, n. 4, p. 1-13, jul. 2017.

JONES, M. Tim. Um guia para iniciantes sobre inteligência artificial, aprendizado de máquina e computação cognitiva. 1 jun. 2017. Disponível em: ibm.com/developerworks/br/library/guia-iniciantes-ia-maquinacomputacao-cognitiva/index.html. Acesso em: 12 jul. 2021.

LEADING Birmingham expert contributes to review on Artificial Intelligence. 13 fev. 2020. Disponível em: birmingham.ac.uk/university/colleges/eps/news/2020/2/leading-birmingham-expert-contributes-toreview-on-artificial-intelligence.aspx. Acesso em: 18 jul. 2021.

LEAL, Luziane de Figueiredo Simão; MORAES FILHO, José Filomeno de. Inteligência artificial e democracia: os algoritmos podem influenciar uma campanha eleitoral? Uma análise do julgamento sobre o impulsionamento de propaganda eleitoral na internet do Tribunal Superior Eleitoral. Direitos Fundamentais & Justiça, Belo Horizonte, ano 13, n. 41, p. 343-356, jul./dez. 2019.

LEE, Kai-Fu. AI Superpowers: China, Silicon Valley, and the New World Order. Boston, MA: Mariner Books, 2018.

LI, Yuezun; CHANG, Ming-Ching; LYU, Siwei. Ictu Oculi: Exposing AI Generated Fake Face Videos by Detecting Eye Blinking. ArXiv, vol. abs/1806.02877, 2018. Disponível em: arxiv.org/pdf/1806.02877.pdf. Acesso em: 04 ago. 2021.

MANOVICH, Lev. Can We Think Without Categories? Disponível em: manovich.net/content/04-projects/105-can-we-think-without-categories/manovich_can_we_think_without_categories_09_14_2018.pdf. Acesso em: 14 set. 2018.

MASOOD, Momina et al. Deepfakes Generation and Detection: State-ofthe-art, open challenges, countermeasures, and way forward. arXiv.org, 25 fev. 2021. Disponível em: arxiv.org/abs/2103.00484. Acesso em: 17 jul. 2021.

MESSARIS, P.; ABRAHAM, L. The role of images in framing news stories. In: REESE, Stephen D.; GANDY, Oscar H.; GRANT, August E. Grant (Eds.). Framing public life, Mahwah, NJ: Erlbaum, 2001, p. 215–226.

RECONTEXTUALIZED media. The Media Manipulation Casebook. Disponível em: mediamanipulation.org/definitions/recontextualizedmedia. Acesso em: 10 jul. 2021.

PRADO, Magaly. Inteligência artificial e algoritmos de enganação. In: SANTAELLA, Lucia (org.). Inteligência artificial & redes sociais. São Paulo: Educ, 2019. p. 57-72.

RAMONET, Ignácio. A opinião pública não quer a verdade, quer confirmar crenças. Entrevista a Cíntia Alves. GGN, 25 dez. 2018. Disponível em: jornalggn.com.br/midia/ignacio-ramonet-a-opiniaopublica-nao-quer-a-verdade-quer-informacoes-que-confirmam-suascrencas/amp. Acesso em: 17 jul. 2021.

SHNURENKO, Igor; MUROVANA, Tatiana; KUSHCHU, Ibrahim. Artificial Intelligence: Media and Information Literacy, Human Rights and Freedom of Expression. Moscow, Hove: UNESCO Institute for Information Technologies in Education, TheNextMinds, 2020.

SPENCER, Michael K. Deep Fake, a mais recente ameaça distópica. Outras Palavras, 30 maio 2019. Disponível em: outraspalavras.net/ tecnologiaemdisputa/deep-fake-a-ultima-distopia. Acesso em: 13 jul. 2021.

TANDOC, JR., Edson C.; WEI LIM, Zheng; LING, Richard. Defining “Fake News”: A typology of scholarly definitions. Digital Journalism, v. 6, n. 2, p. 137-153, 2017.

TRANSPARÊNCIA BRASIL. Recomendações de governança: uso de inteligência artificial pelo poder público. São Paulo, 2020. Disponível em: bit.ly/3xfOXY0. Acesso em: 17 jul. 2021.

UNITED KINGDOM. Centre for Data Ethics and Innovation. Online targeting: Final report and recommendations. London, 2020. Disponível em: gov.uk/government/publications/cdei-review-of-online-targeting/online-targeting-final-report-and-recommendations. Acesso em: 17 jul. 2021.

VERIFICATION Tools. Datajournalism.com. Disponível em: datajournalism.com/read/handbook/verification-1/verification-tools/10-verification-tools. Acesso em: 14 jul. 2021.

WARDLE, Claire. Fake news: It’s complicated. First Draft, 16 fev. 2017. Disponível em: firstdraftnews.org/articles/fake-news-complicated. Acesso em: 12 jul. 2021.

WARDLE, Claire. Information disorder: the essential glossary. 2018. Disponível em: firstdraftnews.org/wp- content/uploads/2018/07/infoDisorder_glossary.pdf. Acesso em: 12 jul. 2021.

Published

2021-10-12

Issue

Section

Artigos