Budapest Post

Cum Deo pro Patria et Libertate
Budapest, Europe and world news

Deepfakes, widely used for fake nudes, could disrupt financial markets

Deepfakes, widely used for fake nudes, could disrupt financial markets

Experts warn that deepfakes could be used for fraudulent transactions or sowing distrust in the financial system, but there are few real-world examples of how it might be done.

Experts have been sounding the alarm about weak biometric data security for years. The problem has looked especially pernicious in China, where facial recognition is now a ubiquitous form of identification. Now the rise of deepfakes could be creating new problems, experts say.

Despite widespread concern about technology, which allows a person’s likeness to be imitated through audio and video, there are few real-world examples of hackers successfully exploiting it for monetary gain.

One of the big concerns has been the idea that deepfakes – to date mainly known for their use in celebrity nudes – could be used to trick facial recognition systems. So far, there is little evidence that this is something that scammers could easily pull off. But some are concerned about other potential problems related to deepfakes that go beyond just personal security to possibly eroding trust in the institutions that handle our money.

“There is an additional problem that deepfakes create,” said Jon Bateman, a fellow at the Carnegie Endowment for International Peace who researches cybersecurity in the financial sector. “That’s not the threat of deception, but the threat of distrust and cynicism, where people start to automatically assume things are fake, because it’s possible to create a deepfake.”

While Bateman said it is extremely unlikely that a deepfake could cause a market crash in an advanced economy with mature financial markets, sowing distrust comes with other pitfalls.


A fake video featuring former US president Barack Obama. Concerns are growing that deepfakes could be used to persuade people to take action by convincing them a request is coming from a person of authority.


It could, for example, contribute to existing anxieties in a financial crisis, especially in less developed countries that already have a high level of distrust, he said. If consumers start to worry about the security of their bank accounts, it could cause a bank run.

Many people working in cybersecurity are also thinking about these problems. In a survey of 105 chief security officers published by biometric authentication provider iProov in January, 77 per cent said they were concerned about the potential impact of deepfake video, audio and images.

The most cited threat was the fraudulent authorisation of payments and transfers, according to the survey published by biometric authentication provider iProov.

While real threats may be rare, it is not purely theoretical. In one unusual case last year, fraudsters used artificial intelligence-based software to fool the CEO of a UK-based energy firm over the phone.

The CEO thought he was talking to the head of his German parent company and wound up sending €220,000 (US$242,000) to what he thought was a supplier. The deepfake audio impersonated the boss’s voice down to his slight German accent.

PwC partner Kok Tin Gan said threats posed by the technology are to be expected.

“Whenever there’s a new technology in place that’s commonly used, that creates an opportunity for the hackers to take advantage because that’s where they can earn money,” said Gan, who calls himself a hacker by profession.

Some companies are already moving to reassure people that deepfakes do not present a problem for their systems.

After a face-swapping app called Zao went viral on Chinese social media in 2019, mobile payments platform Alipay sought to allay fears about the technology. “There are currently many types of face-swapping programs online, but no matter how lifelike the results are, it is impossible to break through facial recognition payments,” the company posted on Weibo.


Allan Xia appearing as Game of Thrones’ Jon Snow in the face-swapping app Zao.


Alipay is one of China’s most widely used mobile payment apps and owned by Ant Group, an affiliate of South China Morning Post parent company Alibaba. Because of widespread appeal, it has been targeted by hackers.

In a 2018 crime that eventually saw five people arrested in China, a group used leaked personal data and photographs to try to steal money through Alipay.

The personal information was used to register accounts on Alipay and the photos were used to create 3D avatars in an attempt to fool the facial recognition. But the logins were quickly flagged and the plan failed.

Facial recognition is now widely used in China, where the technology can be found in everything from banking apps to toilet paper dispensers. But several data leaks in recent years have raised concerns and prompted some backlash.

Large caches of images have shown up online alongside phone and national ID numbers. In one particular case, a bundle of 5,000 images of faces was selling online for just 10 yuan (US$1.40).

Gan said he thinks deepfakes should make people think more about the consequences of giving out their biometric data. While there are advantages to using biometric data for authentication, people cannot change faces or fingerprints the way they can a compromised password, he said.

But as with any new technology, new forms of cyberattacks are being met with new defences. One way companies protect their users is through multiple methods of verification.

If you scan your face to access a banking app, for example, this will only cover the initial authentication, Kok said. Access to other services may still require the familiar tokens and codes sent via SMS. Banks also typically have transfer limits.

Until recent scares over facial recognition, deepfake scams were more commonly associated with fake nude photos or videos shared online. Deepfake pornography that spliced celebrities into adult videos became a widely publicised issue in China last year.

The technology has also been used for more humorous purposes. In October, South Park creators Trey Parker and Matt Stone unveiled a new deepfake show called Sassy Justice on YouTube. The show featured the likeness of US President Donald Trump and Facebook CEO Mark Zuckerberg, among others.


Trey Parker and Matt Stone turn Mark Zuckerberg into a dialysis salesman on their YouTube deepfake show Sassy Justice.


While Kok said he recognises that deepfakes tend to be used more for pornography now than anything else, he said stronger legislation and more transparency from companies will be needed to counter new problems from deepfakes and biometric data breaches.

“I’m sure there will be one massive incident that will cause disruption,” he said.

Some regulators and central banks are also growing concerned about the potential for deepfakes to disrupt markets. Some fintech groups and banks, including HSBC, have already started to prepare for the threat, the Financial Times reported in September.

The potential threats come in different forms: fraudulent accounts could be created for money-laundering; accounts belonging to high-profile individuals could be hijacked; or businesses could be tricked into sending funds to scammers.

For now, experts are still divided on whether deepfakes pose a significant threat. Bateman, the cybersecurity researcher, said that deepfakes are just one among many threats targeting payment apps and financial institutions.

While some believe that deepfakes just give old bank fraud scams a new form, other experts believe that they could lead to an entirely new level of distrust and require new technologies and practices to counter them, Bateman said. Financial institutions are aware of the threat, but there is no consensus on how much it should be prioritised.

“What we’re seeing is the first wave of efforts by the financial sector to experiment with counter technology,” Bateman said. “And I think that’s appropriate because this is an emerging threat. It’s not yet an all-hands-on-deck moment.”

Some researchers and tech companies are already working on solutions such as detection algorithms that can spot sophisticated fakes. This includes Microsoft, which recently developed a video authentication tool that tries to detect signs that an image has been artificially generated in ways that might be invisible to the human eye.

In China, public attitudes about biometric data are already changing. In a survey of more than 6,000 people in 2019, more than 80 per cent said they fear facial data leaks, and 65 per cent were worried about deepfakes. As with other technologies, though, it may take years before the public becomes broadly aware of the problem.

As Gan pointed out, it took more than a decade for people to become aware of the problems brought by social media platforms. Once seen a boon to people looking to stay connected to friends and family, social media is now widely criticized over concerns about user privacy and misinformation.

AI Disclaimer: An advanced artificial intelligence (AI) system generated the content of this page on its own. This innovative technology conducts extensive research from a variety of reliable sources, performs rigorous fact-checking and verification, cleans up and balances biased or manipulated content, and presents a minimal factual summary that is just enough yet essential for you to function as an informed and educated citizen. Please keep in mind, however, that this system is an evolving technology, and as a result, the article may contain accidental inaccuracies or errors. We urge you to help us improve our site by reporting any inaccuracies you find using the "Contact Us" link at the bottom of this page. Your helpful feedback helps us improve our system and deliver more precise content. When you find an article of interest here, please look for the full and extensive coverage of this topic in traditional news sources, as they are written by professional journalists that we try to support, not replace. We appreciate your understanding and assistance.
Newsletter

Related Articles

0:00
0:00
Close
Global Cruise Industry Posts Dramatic Comeback with 34.6 Million Passengers in 2024
U.S. Demands Brussels Scrutinize Digital Rules to Prevent Bias Against American Tech
Private Equity’s Fundraising Surge Triggers Concern of European Market Shake-Out
Tokyo’s Jimbōchō Named World’s Coolest Neighbourhood for 2025
European Officials Fear Trump May Shift Blame for Ukraine War onto EU
The Personality Rights Challenge in India’s AI Era
Italy Considers Freezing Retirement Age at 67 to Avert Scheduled Hike
Italian City to Impose Tax on Visiting Dogs Starting in 2026
Study Finds No Safe Level of Alcohol for Dementia Risk
Trump Says Ukraine Can Fully Restore Borders with NATO Backing
Europe Signals Stronger Support for Taiwan at Major Taipei Defence Show
Germany Weighs Excluding France from Key European Fighter Jet Programme
Cyberattack Disrupts Check-in and Boarding Systems at Major European Airports
Björn Borg Breaks Silence: Memoir Reveals Addiction, Shame and Cancer Battle
When Extremism Hijacks Idealism: How the Baader-Meinhof Gang Emerged and Fell
JWST Data Brings TRAPPIST-1e Closer to Earth-Like Habitability
Trump Orders $100,000 Fee on H-1B Visas and Launches ‘Gold Card’ Immigration Pathway
France’s Looming Budget Crisis and Political Fracture Raise Fears of Becoming Europe’s “Sick Man”
Three Russian MiG-31 Jets Breach Estonian Airspace in ‘Unprecedentedly Brazen’ NATO Incident
European manufacturers against ban on polluting cars: "The industry may collapse"
Turkish car manufacturer Togg Enters German Market with 5-Star Electric Sedan and SUV to Challenge European EV Brands
Christian Brueckner Released from German Prison after Serving Unrelated Sentence
World’s Longest Direct Flight China Eastern to Launch 29-Hour Shanghai–Buenos Aires Direct Flight via Auckland in December
New OpenAI Study Finds Majority of ChatGPT Use Is Personal, Not Professional
The conservative right spreads westward: a huge achievement for 'Alternative for Germany' in local elections
Pope Leo Warns of Societal Crisis Over Mega-CEO Pay, Citing Tesla’s Proposed Trillion-Dollar Package
Poland Green-Lights NATO Deployment in Response to Major Russian Drone Incursion
U.S. and China Agree on Framework to Shift TikTok to American Ownership
Le Pen Tightens the Pressure on Macron as France Edges Toward Political Breakdown
Czech Republic signs €1.34 billion contract for Leopard 2A8 main battle tanks with delivery from 2028
Penske Media Sues Google Over “AI Overviews,” Claiming It Uses Journalism Without Consent and Destroys Traffic
Indian Student Engineers Propose “Project REBIRTH” to Protect Aircraft from Crashes Using AI, Airbags and Smart Materials
One in Three Europeans Now Uses TikTok, According to the Chinese Tech Giant
Could AI Nursing Robots Help Healthcare Staffing Shortages?
NATO Deploys ‘Eastern Sentry’ After Russian Drones Violate Polish Airspace
The New Life of Novak Djokovic
German police raid AfD lawmaker’s offices in inquiry over Chinese payments
Volkswagen launches aggressive strategy to fend off Chinese challenge in Europe’s EV market
France Erupts in Mass ‘Block Everything’ Protests on New PM’s First Day
Poland Shoots Down Russian Drones in Airspace Violation During Ukraine Attack
Apple Introduces Ultra-Thin iPhone Air, Enhanced 17 Series and New Health-Focused Wearables
Macron Appoints Sébastien Lecornu as Prime Minister Amid Budget Crisis and Political Turmoil
Vatican hosts first Catholic LGBTQ pilgrimage
Apple Unveils iPhone 17 Series, iPhone Air, Apple Watch 11 and More at 'Awe Dropping' Event
France joins Eurozone’s ‘periphery’ as turmoil deepens, say investors
France Faces New Political Crisis, again, as Prime Minister Bayrou Pushed Out
Nayib Bukele Points Out Belgian Hypocrisy as Brussels Considers Sending Army into the Streets
France, at an Impasse, Heads Toward Another Government Collapse
The Country That Got Too Rich? Public Spending Dominates Norway Election
EU Proposes Phasing Out Russian Oil and Gas by End of 2027 to End Energy Dependence
×