Movie makers will be able to recreate classic scenes in movies, create new movies starring long-dead actors, make use of special effects and advanced face editing in post-production, and improve amateur videos to professional quality (FOX05; GRD07). At the same time, the study reckons that there are growing needs for online source verification and content authentication, and that ubiquitous truth layers based on digital watermarks should be used. Authentication of video is especially important to news media companies who have to determine authenticity of a video spreading in a trustless environment, in which details of the video’s creator, origin, and distribution may be hard to trace (WP01). [check quotation syntax] https://doi.org/10.1177/2372732218814855. Also, AI can provide unique artificial voices that differentiate companies and products to make branding distinction easier (PCM10). [132] DARPA has also created a Media Forensics (MediFor) program, to mitigate the increasing harm that deepfakes and AI-generated media poses. Paired Training. In separate videos, the face of the Argentine President, Deepfake technology is part of the plot of the 2019, This page was last edited on 10 May 2021, at 17:39. Deepfake technologies: What they are, what they do, and how they’re made Photo: Alexandra Robinson/AFP/Getty Images. This study relies on the emerging scholarly literature and publicly available news articles on deepfakes. With the technology becoming accessible to any computer user, more and more researchers are focusing on deepfake detection and looking for a way of regulating it. Thus, celebrities such as Scarlett Johansson have been featured on deepfaked adult movies, in which their faces have been superimposed over porn stars' faces (CNET08; PCM03). Perceptual Judgments to Detect Computer Generated Forged Faces in Social Media. [28] As of 2019, FakeApp has been superseded by open-source alternatives such as Faceswap, command line-based DeepFaceLab, and web-based apps such as DeepfakesWeb.com [29][30][31]. Journal of Data and Information Quality, 11(3): Article 12. https://doi.org/10.1145/3297722, Atodiresei, C.-S., Tănăselea, A., & Iftene, A. [92] In this deepfake, Jimmy Fallon's face was transformed into Donald Trump's face (audio remained the same). Digitally constructed/altered humans have already been used in films before, and deepfakes could contribute new developments in the near future. Also, commentary sections in some of the analyzed news articles had extensive amount of opinions and ideas from readers; analysis of those comments might give additional insights on how deepfakes are perceived by a larger audience, and thus what education-oriented combat methods should emphasize. [99], Most of the academic research surrounding deepfake seeks to detect the videos. We believe deepfake technology should be clearly labelled. Journal of Data and Information Quality, 1(3): Article No. In the future, video calls will also be able to be faked in real-time. The focus of the selected news media ranged from general daily news to concentration on business or technology news. Recently, researchers found that a website devoted to deepfakes used its visitors’ computers to mine cryptocurrencies. For instance, users upload 500 hours of content per minute on YouTube. Deepfakes are a major threat to our society, political system, and business because they 1) put pressure on journalists struggling to filter real from fake news, 2) threaten national security by disseminating propaganda and interfering in elections, 3) hamper citizen trust toward information by authorities, and, 4) raise cybersecurity issues for people and organizations. As for technology, deepfakes are the product of Generative Adversarial Networks (GANs), namely two artificial neural networks working together to create real-looking media (CNN03). [21] The survey identifies that researchers have been focusing on resolving the following challenges of deepfake creation: Overall, deepfakes are expected to have several implications in media and society, media production, media representations, media audiences, gender, law, and regulation, and politics. A deepfake might show, for example, Nicolas Cage acting in movies in which he has never starred in, such as Indiana Jones or Terminator 2 (CNET05; PCM10). In the series, the melancholic song is sung by the player in a karaoke minigame. [92] On 5 May 2019 a deepfake of Donald Trump (taken from this skit) was created. [4][5], Deepfakes have garnered widespread attention for their uses in celebrity pornographic videos, revenge porn, fake news, hoaxes, and financial fraud. The latter method can be tailored for individuals, such as high-profile politicians who are likely to be deepfaked (PCM01). [26], In January 2018, a proprietary desktop application called FakeApp was launched. Individuals in deepfake hobby communities are difficult to track down (FRB06). Please visit our Forums for any questions. [78] In January 2020 Facebook announced that it was introducing new measures to counter this on its platforms. 2019. The majority of such deepfakes are goofs, pranks, and funny memes with comedic or satirical effect (CNET07; DD01). [126], In the United Kingdom, producers of deepfake material can be prosecuted for harassment, but there are calls to make deepfake a specific crime;[127] in the United States, where charges as varied as identity theft, cyberstalking, and revenge porn have been pursued, the notion of a more comprehensive statute has also been discussed. The Future of Misinformation. [133], Artificial intelligence-based human image synthesis technique, Katerina Cizek, William Uricchio, and Sarah Wolozin: Collective Wisdom | Massachusetts Institute of Technology, Defense Advanced Research Projects Agency, "Terrifying high-tech porn: Creepy 'deepfake' videos are on the rise", "Prepare, Don't Panic: Synthetic Media and Deepfakes", "You thought fake news was bad? [17], In August 2018, researchers at the University of California, Berkeley published a paper introducing a fake dancing app that can create the impression of masterful dancing ability using AI. Similar to the cybersecurity domain in general, the first step towards a solution is understanding the problem and its ability to affect us. The app had both a paid and unpaid version, the paid version costing $50. ANALYSIS OF DEEPFAKE THREATS. There are at least four major types of deepfake producers: 1) communities of deepfake hobbyists, 2) political players such as foreign governments, and various activists, 3) other malevolent actors such as fraudsters, and 4) legitimate actors, such as television companies. Anwar, S., Milanova, M., Anwer, M., & Banihirwe, A. [16] The project lists as a main research contribution its photorealistic technique for synthesizing mouth shapes from audio. We also leave clear traces of manipulation in the video data so it's easy to identify as fake. Some government agencies today are using voice recognition for … Authors retain full copyright to their individual works. [24], Other online communities remain, including Reddit communities that do not share pornography, such as r/SFWdeepfakes (short for "safe for work deepfakes"), in which community members share deepfakes depicting celebrities, politicians, and others in non-pornographic scenarios. The photographs appear to have been generated by "human image synthesis" technology, computer software that takes data from photos of real people to produce a realistic composite image of a non-existent person. Audio deepfakes, and AI software capable of detecting deepfakes and cloning human voices after 5 seconds of listening time also exist. Simple software tools such as FakeApp and DeepFaceLab have since made a comparable effect available to all. Finally, technology can prevent the creation of deepfakes by inserting “noise” into photos or videos. Many hobbyists focus on porn-related deepfakes (USAT01), while others place famous actors in films in which they never appeared to produce comic effects (GRD05). Anti-deepfake technology provides perhaps the most varied set of tools to 1) detect deepfakes, 2) authenticate content, and 3) prevent content from being used to produce deepfakes. https://doi.org/10.1016/j.chb.2017.11.034, Lin, H. 2019. 730. Indeed, digital watermarking such as hashing can provide a video file with a short string of numbers that is lost if the video is manipulated (FOX04; FRB04). Cybenko, A. K., & Cybenko, G. 2018. Technology steadily improved during the 20th century, and more quickly with digital video. In order to fight against deepfakes, we need to understand deepfakes, the reasons for their existence, and the technology behind them. Theatre Journal, 70(4): 455–471. It is feared that such techniques are a new battleground in disinformation. Copyright © Talent First Network 2007–2021          ISSN: 1927-0321          Formerly the Open Source Business ResourceThe Technology Innovation Management Review is published under a Creative Commons Attribution 3.0 Unported License. Among news media companies, Wall Street Journal and Reuters have formed corporate teams to help and train their reporters to identify fake content, and to adopt detection techniques and tools such as cross-referencing location on Google maps and reverse image searching (DD01; DD02; CNN01). Using Blockchain to Rein in the New Post-Truth World and Check the Spread of Fake News. Army researchers developed a Deepfake detection method that will allow for the creation of state-of-the-art Soldier technology to support mission-essential tasks such as adversarial threat detection and recognition. [50] A report published in October 2019 by Dutch cybersecurity startup Deeptrace estimated that 96% of all deepfakes online were pornographic. [14] The mobile app giant Momo created the application Zao which allows users to superimpose their face on television and movie clips with a single picture. Presently, one out of five Internet users get their news via YouTube, second only to Facebook (Anderson, 2018). In the near future, GANs will be trained on less information and be able to swap heads, whole bodies, and voices (GRD08; USAT01). [41] This hologram was created by the company Kaleida, where they use a combination of performance, motion tracking, SFX, VFX and DeepFake technologies in their hologram creation.[42]. However, scholarly research has only recently begun to address digital disinformation in social media (Anderson, 2018). Mika earned his doctoral degree in Marketing from the Helsinki School of Economics in Finland. Philosophy & Technology, 31(3): 317–321. A deepfake of Donald Trump was easily created based on a skit Jimmy Fallon performed on NBC's The Tonight Show. Larger companies are also starting to use deepfakes. Several newspapers have not retracted "his" articles or removed them from their websites. This is the process of finding examples of inputs and their desired outputs for the model to learn from. This creates massive challenges for technologies to go through all of the posted material in a short time. Intelligence, 65: 107–110. https://doi.org/10.1177/1365712718807226, Qayyum, A., Qadir, J., Janjua, M. U. New fake-detection algorithms are based on mammalian auditory systems, for example, the ways mice detect inconsistencies and subtle mistakes in audio, which are often ignored by humans (CNET02). 2019. At present, deepfakes are not specifically addressed by civil or criminal laws, although legal experts have suggested adapting current laws to cover libel, defamation, identity fraud, or impersonating a government official using deepfakes (FT02; WP01). It is highly probably that the journalism industry is going to have to face a massive consumer trust issue due to deepfakes (USAT01). [88], In September 2020 Microsoft made public that they are developing a Deepfake detection software tool. Scientists are also exploring the use of GANs to detect abnormalities in X-rays (CNET04) and their potential in creating virtual chemical molecules to speed up materials science and medical discoveries (GRD03). International Journal of Evidence & Proof, 23(3): 255–262. But there are also examples from the dark side of deepfakes, namely celebrity and revenge porn, as well as attempts at political and non-political influencing. The existential threat from cyber-enabled information warfare. ", "KANYE WEST GAVE KIM KARDASHIAN A HOLOGRAM OF HER FATHER FOR HER BIRTHDAY", "Parkland victim Joaquin Oliver comes back to life in heartbreaking plea to voters", "Understanding the Technology Behind DeepFakes", "These New Tricks Can Outsmart Deepfake Videos—for Now", "Deepfake Porn Is Still a Threat, Particularly for K-Pop Stars", "Porn Producers Offer to Help Hollywood Take Down Deepfake Videos", "The State of Deepfake - Landscape, Threats, and Impact", "From porn to 'Game of Thrones': How deepfakes and realistic-looking fake videos hit it big", "Gfycat's AI Solution for Fighting Deepfakes Isn't Working", "This Horrifying App Undresses a Photo of Any Woman with a Single Click", "GitHub Removed Open Source Versions of DeepNude", "Wenn Merkel plötzlich Trumps Gesicht trägt: die gefährliche Manipulation von Bildern und Videos", "Deepfakes: Auf dem Weg in eine alternative Realität? Lecture Notes in Computer Science, vol. The game-changing factor of deepfakes is the scope, scale, and sophistication of the technology involved, as almost anyone with a computer can fabricate fake videos that are practically indistinguishable from authentic media (Fletcher, 2018). ", "Harrison Ford is the star of Solo: A Star Wars Story thanks to deepfake technology", "How acting as Carrie Fisher's puppet made a career for Rogue One's Princess Leia", "High-Resolution Neural Face Swapping for Visual Effects | Disney Research Studios", "Disney's deepfake technology could be used in film and TV", "Disney Ventures Into Bringing Back 'Dead Actors' Through Facial Recognition", "Coffin Dance and More: The Music Memes of 2020 So Far", "Someone deepfaked Singapore's politicians to lip-sync that Japanese meme song", "Chinese Deepfake App Zao Goes Viral, Faces Immediate Criticism Over User Data And Security Policy", "Ahead of Irish and US elections, Facebook announces new measures against 'deepfake' videos", Deepfake Used to Attack Activist Couple Shows New Disinformation Frontier, "‘Leftists for Bibi’? Wagner, T.L., & Blewer, A. International Journal of Advance Research and Development, 4(6): 4–8. The reviewed news articles suggest that there are four ways to combat deepfakes: 1) legislation and regulation, 2) corporate policies and voluntary action, 3) education and training, and 4) anti-deepfake technology that includes deepfake detection, content authentication, and deepfake prevention. Also, researchers who are developing GAN technologies can design and put proper safeguards in place so that their technologies become more difficult to misuse for disinformation purposes (FOX06). That is, unfortunately, the nature of how it was first exposed to the public, but it is not representative of why it was created, how we use it now, or what we see in its future. [25] Other online communities continue to share pornography on platforms that have not banned deepfake pornography. Basic Tools. 602 provides individuals targeted by sexually explicit deepfake content made without their consent with a cause of action against the content's creator. & Sher, F. 2019. Oliver's parents teamed up on behalf of their organization Nonprofit Change the Ref, with McCann Health to produce this deepfake video advocating for gun-safety voting campaign. This can then be decoded with a model trained specifically for the target. History. DeepFaceLab. In so doing, the study analyzes a number of news articles on deepfakes drawn from news media websites. IEEE Access, 7: 41596–41606. It is also important to remember that quality is not an indicator of a video’s authenticity (FOX04; FRB01).