Budapest Post

Cum Deo pro Patria et Libertate
Budapest, Europe and world news

Deepfakes, widely used for fake nudes, could disrupt financial markets

Deepfakes, widely used for fake nudes, could disrupt financial markets

Experts warn that deepfakes could be used for fraudulent transactions or sowing distrust in the financial system, but there are few real-world examples of how it might be done.

Experts have been sounding the alarm about weak biometric data security for years. The problem has looked especially pernicious in China, where facial recognition is now a ubiquitous form of identification. Now the rise of deepfakes could be creating new problems, experts say.

Despite widespread concern about technology, which allows a person’s likeness to be imitated through audio and video, there are few real-world examples of hackers successfully exploiting it for monetary gain.

One of the big concerns has been the idea that deepfakes – to date mainly known for their use in celebrity nudes – could be used to trick facial recognition systems. So far, there is little evidence that this is something that scammers could easily pull off. But some are concerned about other potential problems related to deepfakes that go beyond just personal security to possibly eroding trust in the institutions that handle our money.

“There is an additional problem that deepfakes create,” said Jon Bateman, a fellow at the Carnegie Endowment for International Peace who researches cybersecurity in the financial sector. “That’s not the threat of deception, but the threat of distrust and cynicism, where people start to automatically assume things are fake, because it’s possible to create a deepfake.”

While Bateman said it is extremely unlikely that a deepfake could cause a market crash in an advanced economy with mature financial markets, sowing distrust comes with other pitfalls.


A fake video featuring former US president Barack Obama. Concerns are growing that deepfakes could be used to persuade people to take action by convincing them a request is coming from a person of authority.


It could, for example, contribute to existing anxieties in a financial crisis, especially in less developed countries that already have a high level of distrust, he said. If consumers start to worry about the security of their bank accounts, it could cause a bank run.

Many people working in cybersecurity are also thinking about these problems. In a survey of 105 chief security officers published by biometric authentication provider iProov in January, 77 per cent said they were concerned about the potential impact of deepfake video, audio and images.

The most cited threat was the fraudulent authorisation of payments and transfers, according to the survey published by biometric authentication provider iProov.

While real threats may be rare, it is not purely theoretical. In one unusual case last year, fraudsters used artificial intelligence-based software to fool the CEO of a UK-based energy firm over the phone.

The CEO thought he was talking to the head of his German parent company and wound up sending €220,000 (US$242,000) to what he thought was a supplier. The deepfake audio impersonated the boss’s voice down to his slight German accent.

PwC partner Kok Tin Gan said threats posed by the technology are to be expected.

“Whenever there’s a new technology in place that’s commonly used, that creates an opportunity for the hackers to take advantage because that’s where they can earn money,” said Gan, who calls himself a hacker by profession.

Some companies are already moving to reassure people that deepfakes do not present a problem for their systems.

After a face-swapping app called Zao went viral on Chinese social media in 2019, mobile payments platform Alipay sought to allay fears about the technology. “There are currently many types of face-swapping programs online, but no matter how lifelike the results are, it is impossible to break through facial recognition payments,” the company posted on Weibo.


Allan Xia appearing as Game of Thrones’ Jon Snow in the face-swapping app Zao.


Alipay is one of China’s most widely used mobile payment apps and owned by Ant Group, an affiliate of South China Morning Post parent company Alibaba. Because of widespread appeal, it has been targeted by hackers.

In a 2018 crime that eventually saw five people arrested in China, a group used leaked personal data and photographs to try to steal money through Alipay.

The personal information was used to register accounts on Alipay and the photos were used to create 3D avatars in an attempt to fool the facial recognition. But the logins were quickly flagged and the plan failed.

Facial recognition is now widely used in China, where the technology can be found in everything from banking apps to toilet paper dispensers. But several data leaks in recent years have raised concerns and prompted some backlash.

Large caches of images have shown up online alongside phone and national ID numbers. In one particular case, a bundle of 5,000 images of faces was selling online for just 10 yuan (US$1.40).

Gan said he thinks deepfakes should make people think more about the consequences of giving out their biometric data. While there are advantages to using biometric data for authentication, people cannot change faces or fingerprints the way they can a compromised password, he said.

But as with any new technology, new forms of cyberattacks are being met with new defences. One way companies protect their users is through multiple methods of verification.

If you scan your face to access a banking app, for example, this will only cover the initial authentication, Kok said. Access to other services may still require the familiar tokens and codes sent via SMS. Banks also typically have transfer limits.

Until recent scares over facial recognition, deepfake scams were more commonly associated with fake nude photos or videos shared online. Deepfake pornography that spliced celebrities into adult videos became a widely publicised issue in China last year.

The technology has also been used for more humorous purposes. In October, South Park creators Trey Parker and Matt Stone unveiled a new deepfake show called Sassy Justice on YouTube. The show featured the likeness of US President Donald Trump and Facebook CEO Mark Zuckerberg, among others.


Trey Parker and Matt Stone turn Mark Zuckerberg into a dialysis salesman on their YouTube deepfake show Sassy Justice.


While Kok said he recognises that deepfakes tend to be used more for pornography now than anything else, he said stronger legislation and more transparency from companies will be needed to counter new problems from deepfakes and biometric data breaches.

“I’m sure there will be one massive incident that will cause disruption,” he said.

Some regulators and central banks are also growing concerned about the potential for deepfakes to disrupt markets. Some fintech groups and banks, including HSBC, have already started to prepare for the threat, the Financial Times reported in September.

The potential threats come in different forms: fraudulent accounts could be created for money-laundering; accounts belonging to high-profile individuals could be hijacked; or businesses could be tricked into sending funds to scammers.

For now, experts are still divided on whether deepfakes pose a significant threat. Bateman, the cybersecurity researcher, said that deepfakes are just one among many threats targeting payment apps and financial institutions.

While some believe that deepfakes just give old bank fraud scams a new form, other experts believe that they could lead to an entirely new level of distrust and require new technologies and practices to counter them, Bateman said. Financial institutions are aware of the threat, but there is no consensus on how much it should be prioritised.

“What we’re seeing is the first wave of efforts by the financial sector to experiment with counter technology,” Bateman said. “And I think that’s appropriate because this is an emerging threat. It’s not yet an all-hands-on-deck moment.”

Some researchers and tech companies are already working on solutions such as detection algorithms that can spot sophisticated fakes. This includes Microsoft, which recently developed a video authentication tool that tries to detect signs that an image has been artificially generated in ways that might be invisible to the human eye.

In China, public attitudes about biometric data are already changing. In a survey of more than 6,000 people in 2019, more than 80 per cent said they fear facial data leaks, and 65 per cent were worried about deepfakes. As with other technologies, though, it may take years before the public becomes broadly aware of the problem.

As Gan pointed out, it took more than a decade for people to become aware of the problems brought by social media platforms. Once seen a boon to people looking to stay connected to friends and family, social media is now widely criticized over concerns about user privacy and misinformation.

AI Disclaimer: An advanced artificial intelligence (AI) system generated the content of this page on its own. This innovative technology conducts extensive research from a variety of reliable sources, performs rigorous fact-checking and verification, cleans up and balances biased or manipulated content, and presents a minimal factual summary that is just enough yet essential for you to function as an informed and educated citizen. Please keep in mind, however, that this system is an evolving technology, and as a result, the article may contain accidental inaccuracies or errors. We urge you to help us improve our site by reporting any inaccuracies you find using the "Contact Us" link at the bottom of this page. Your helpful feedback helps us improve our system and deliver more precise content. When you find an article of interest here, please look for the full and extensive coverage of this topic in traditional news sources, as they are written by professional journalists that we try to support, not replace. We appreciate your understanding and assistance.
Newsletter

Related Articles

0:00
0:00
Close
IMF Upgrades Global Growth Forecast as Weaker Dollar Supports Outlook
House Republicans Move to Defund OECD Over Global Tax Dispute
France Opens Criminal Investigation into X Over Algorithm Manipulation Allegations
Trump Steamrolls EU in Landmark Trade Win: US–EU Trade Deal Imposes 15% Tariff on European Imports
ChatGPT CEO Sam Altman says people share personal info with ChatGPT but don’t know chats can be used as court evidence in legal cases.
Intel Reports Revenue Beats but Sees 81% Rise in Losses
Politics is a good business: Barack Obama’s Reported Net Worth Growth, 1990–2025
UN's Top Court Declares Environmental Protection a Legal Obligation Under International Law
"Crazy Thing": OpenAI's Sam Altman Warns Of AI Voice Fraud Crisis In Banking
The Podcaster Who Accidentally Revealed He Earns Over $10 Million a Year
UK Government Considers Dropping Demand for Apple Encryption Backdoor
Japanese Man Discovers Family Connection Through DNA Testing After Decades of Separation
Russia Signals Openness to Ukraine Peace Talks Amid Escalating Drone Warfare
Switzerland Implements Ban on Mammography Screening
Pogacar Extends Dominance with Stage Fifteen Triumph at Tour de France
President Trump Diagnosed with Chronic Venous Insufficiency After Leg Swelling
CEO Resigns Amid Controversy Over Relationship with HR Executive
NVIDIA Achieves $4 Trillion Valuation Amid AI Demand
Tulsi Gabbard Unveils Evidence Alleging Political Manipulation of Intelligence During Trump Administration
Centrist Criticism of von der Leyen Resurfaces as she Survives EU Confidence Vote
Trump Announces Coca-Cola to Shift to Cane Sugar in U.S. Production
FIFA Pressured to Rethink World Cup Calendar Due to Climate Change
Zelensky Reshuffles Cabinet to Win Support at Home and in Washington
"Can You Hit Moscow?" Trump Asked Zelensky To Make Putin "Feel The Pain"
Church of England Removes 1991 Sexuality Guidelines from Clergy Selection
Superman Franchise Achieves Success with Latest Release
Hungary's Viktor Orban Rejects Agreements on Illegal Migration
Air India Pilot’s Mental Health Records Under Scrutiny
Jamie Dimon Warns Europe Is Losing Global Competitiveness and Flags Market Complacency
Moonshot AI Unveils Kimi K2: A New Open-Source AI Model
Martha Wells Says Humanity Still Far from True Artificial Intelligence
Nvidia Becomes World’s First Four‑Trillion‑Dollar Company Amid AI Boom
EU Delays Retaliatory Tariffs Amid New U.S. Threats on Imports
Trump Proposes Supplying Arms to Ukraine Through NATO Allies
US Opens First Rare Earth Mine in Over 70 Years in Wyoming
Bitcoin Reaches New Milestone of $116,000
Severe Heatwave Claims 2,300 Lives Across Europe
Declining Beer Consumption Signals Cultural Shift in Germany
Emails Leaked: How Passenger Luggage Became a Side Income for Airport Workers
Polish MEP: “Dear Leftists - China is laughing at you, Russia is laughing, India is laughing”
Western Europe Records Hottest June on Record
BRICS Expands Membership with Indonesia and Ten New Partner Countries
Elon Musk Founds a Party Following a Poll on X: "You Wanted It – You Got It!"
China’s Central Bank Consults European Peers on Low-Rate Strategies
France Requests Airlines to Cut Flights at Paris Airports Amid Planned Air Traffic Controller Strike
Poland Implements Border Checks Amid Growing Migration Tensions
Emirates Airline Expands Market Share with New $20 Million Campaign
Amazon Reaches Milestone with Deployment of One Millionth Robot
Yulia Putintseva Calls for Spectator Ejection at Wimbledon Over Safety Concerns
House Oversight Committee Subpoenas Former Jill Biden Aide Amid Investigation into Alleged Concealment of President Biden's Cognitive Health
×