Budapest Post

Cum Deo pro Patria et Libertate
Budapest, Europe and world news

How fake accounts pushing inflammatory content went viral - with the help of YouTube's algorithms

How fake accounts pushing inflammatory content went viral - with the help of YouTube's algorithms

YouTube channels posing as American news outlets racked up millions of views on false and inflammatory videos over several months this year, all with the help of YouTube's recommendation engine.
Many of the accounts, which mostly used footage from CNN, but also employed some video from Fox News, exploited a YouTube feature that automatically creates channels on certain topics. Those topic channels are then automatically populated by videos related to the topic - including, in this case, blatant misinformation. YouTube has now shut down many of the accounts.

YouTube's own algorithms also recommended videos from the channels to American users who watched videos about US politics. That the channels could achieve such virality - one channel was viewed more than two million times over one weekend in October - raises questions about YouTube's preparedness for tackling misinformation on its platform just weeks before the Iowa caucuses and points to the continuing challenge platforms face as people try to game their systems.

In recent years, YouTube, which is owned by Google, has taken steps to increase the likelihood users will be recommended videos from what it determines as authoritative sources, like news outlets.

Plasticity, a San Francisco natural language processing and artificial intelligence startup that gathered and analyzed the YouTube data, provided CNN with hundreds of examples of how the accounts had doctored on-screen graphics to make stories appear inflammatory.

YouTube told CNN Business on Thursday that its threat analysis team had investigated and determined the channels were run from Southeast Asia and were part of a spam campaign, designed to make money from online ads. The company said it found nothing to suggest that the channels were linked to a state-backed campaign or that they were part of a coordinated influence campaign. Although Plasticity and CNN saw hundreds of videos that were about news and politics, YouTube said they removed many more videos that were entertainment clips.

To help their videos go viral the person or people behind the YouTube channels created hundreds of false images that altered CNN's on-screen graphics to make stories and CNN's coverage of them appear inflammatory. Once the user clicked into the video, unaltered CNN footage would play.

One video was promoted using an image that falsely made it appear as if CNN had run an on-screen graphic that stated the "President is a disgrace" and showed a doctored image of President Trump with a noose around his neck.

Another image showed a fake CNN on-screen graphic that read "War officially started!" and showed pictures of President Trump and the president of Iran.

Responding to the findings on Thursday, a CNN spokesperson said YouTube needs to take responsibility.

"Manipulation of our brand and intellectual property with the specific intent to misinform the public is an incredibly serious problem that platforms need to urgently address," the spokesperson said. "Platforms like YouTube bear a responsibility to manage the integrity of the content they deliver to audiences. That's something journalists know and have been doing effectively for generations. It's a core difference between platforms and publishers."

A spokesperson for Fox News declined to comment.

"Unfortunately, reuploading content with sensationalist thumbnails is a common tactic spammers use in an attempt to attract views and revenue," a YouTube spokesperson said in a statement to CNN Business on Thursday. "We use a combination of machine learning and human review to identify and remove spam accounts, last quarter alone we removed nearly 5 million videos and 3 million channels for spam violations. We've taken action against these accounts and will continue our work to remove spam from the platform."

YouTube said it had already shut down many channels prior to Plasticity's findings -- but used information provided to them by the firm to shut down 25 more.

Social media platforms have been plagued with fake accounts targeting Americans. Some are run by nation states, like Russia and Iran, for geopolitical or ideological purposes. Other accounts are run by scammers and people trying to make a quick buck through online ads.

But while their motivations may be different, scammers and nation state actors use similar playbooks, pushing content that focuses on divisions in American politics and society.

Darren Linvill, an associate professor at Clemson University who reviewed Plasticity's data, told CNN Business that, regardless of the motives of the people behind the channels, it is the effect that matters.

Linvill pointed to the polarizing, false, and inflammatory thumbnails and captions used on the YouTube channels discovered by Plasticity as an example of how scammers, spammers and nation state actors are using similar techniques and focusing on the same divisive issues.

"The roots of this are the same," he said, "it's about how you communicate with people and get them to pay attention to you online."

Plasticity began monitoring the fake accounts at the end of November after Ajay Patel, one of Plasticity's co-founders, noticed YouTube was repeatedly recommending he watch videos from the channels.

Over the course of just one week, Plasticity said, it found more than two dozen YouTube channels that had more than 8 million views combined that were posting US news videos with false and misleading thumbnails and titles.

In October, CNN Business observed a channel using similar tactics. YouTube's own algorithms recommended users watch videos on some of the channels, according to a CNN Business review in October of data from AlgoTransparency, a tool that tracks what YouTube recommends.

"The professionalism of the operation surprised me. It felt like a round-the-clock operation putting out new content with fake thumbnails and headlines every few hours," Patel told CNN Business Thursday. "When accounts were deleted or banned, they were able to spin up new accounts within hours. The tactics they used to game the YouTube algorithm were executed perfectly. They knew what they were doing,"

Plasticity reported its findings to YouTube and subsequently briefed representatives from the company by phone. YouTube removed the channels Plasticity identified.

Plasticity and CNN Business found some evidence to suggest, but did not confirm, some of the accounts posting the videos had been potentially stolen from other YouTube users and repurposed. YouTube declined to comment on this.
AI Disclaimer: An advanced artificial intelligence (AI) system generated the content of this page on its own. This innovative technology conducts extensive research from a variety of reliable sources, performs rigorous fact-checking and verification, cleans up and balances biased or manipulated content, and presents a minimal factual summary that is just enough yet essential for you to function as an informed and educated citizen. Please keep in mind, however, that this system is an evolving technology, and as a result, the article may contain accidental inaccuracies or errors. We urge you to help us improve our site by reporting any inaccuracies you find using the "Contact Us" link at the bottom of this page. Your helpful feedback helps us improve our system and deliver more precise content. When you find an article of interest here, please look for the full and extensive coverage of this topic in traditional news sources, as they are written by professional journalists that we try to support, not replace. We appreciate your understanding and assistance.
Newsletter

Related Articles

0:00
0:00
Close
Miliband Sets Climate and International Law at Centre of UK Diplomacy
Czech Central Bank Governor Rejects Early Euro Entry and Rate-Cut Pressure
Trump Readies New Tariffs as Temporary Global Levy Nears Expiry
Vivienne Westwood Casts Cicciolina, 74, in Its New Autumn Campaign
Dejavu: Germany’s Military Expansion Reshapes Europe’s Strategic Balance With France
Morgan Stanley Builds a Wall Street Lead in AI Infrastructure Finance
High Prices Push Coffee Drinkers Toward Whole Beans and Home Brewing
Trump Draws Boos and Podium Scrutiny at Spain’s World Cup Triumph
Brilliant move: Péter Magyar Moves to Nominate Chess Grandmaster Judit Polgár as Hungary’s President
Spain Defeats Argentina in Extra Time to Win Second World Cup
Current AI Seeks to Build an Open Global AI Infrastructure Outside Big Tech Control
Germany’s Economic Malaise Reopens the Sunday Shopping Debate
Proposed U.S.-Saudi Nuclear Pact Could Permit Limited Uranium Enrichment Under International Safeguards
Netherlands Declares Water Shortage Emergency After Drought Pushes Rivers to Historic Lows
Why Kentucky Fried Chicken Became KFC—and Why the False Explanations Persist
Ukrainian Drones Strike Wildberries Warehouses Deep Inside Russia
Reported CIA Mission Helped Clear the UAE’s Path to Advanced US AI Chips
Artificial Intelligence Capital Fuels Markets While Governments and Regulators Face Mounting Strategic Tests
China’s Moonshot’s Kimi K3 Narrows the Gap With Anthropic Through Scale, Openness and Lower Cost
The Ledger Will Not Trust on Faith
Trump Administration Pressures Banks to Restrict Financial Access for Undocumented Immigrants
Passenger Bound for Germany Refused to Sit Beside a Woman on a Plane — Then Slapped a Flight Attendant
Ukraine’s Leadership Rift Spills Into the Streets as Protesters Target Army Chief
Ukrainian Drone Barrage Kills Eight and Strikes Russian Logistics Network
The Ten World Cup Finals That Defined Football History
Smartphones Are Getting More Expensive, Sales Are Collapsing, and Even Apple Admits: "Prices Will Rise"
The Monaco Bombing Has Become a Test of Ukraine’s Intelligence Accountability
Leadership Change and Strategic Rivalry Redraw the Political Map
The AI Race Enters Its Infrastructure Era
Britain Nationalises British Steel to Protect Scunthorpe Production and Strategic Supply
French National Assembly Overrides Senate to Pass Historic Assisted-Dying Legislation
Spanish Prime Minister's Wife Ordered to Stand Trial as Corruption Probes Encircle Governing Party
Zelensky Faces Kyiv Protests Over Ousting of Dynamic Ukrainian Defense Minister
Thomas Tuchel Faces Fierce Backlash After Tactical Retreat Costs England World Cup Final Berth
A Quiet Bastille Day: France Grapples with World Cup Heartbreak and Leftover Fireworks
Spain in Ecstasy: "We Feel Unbeatable, We Taught the Whole World a Lesson"
Spain and UK Dismantle Gibraltar Border Following Landmark Schengen Integration Treaty
Hungary's "Puppet" President to Be Ousted, Orbán Fumes: "Democracy Is Dead"
Forget Tinder: The Surprising Platform Where People Find Love
Harvard Astrophysicist to Lead U.S. Scientific Advisory on Unidentified Aerial Phenomena
Emergency Sirens Activated Across Bahrain as Interior Ministry Issues Shelter Directives
World Cup Visitors Turn American Big-Box Stores Into Souvenir Stops
Netflix Weighs Always-On Channels, Bundles and Short-Form Video
Passenger Is Pulled Partly Outside Ryanair Jet After Window Fails Mid-Flight
The AI Invoice Shock: Layoffs Didn't Save Managers Money — They Cost Them More
Concern: Sexually Transmitted Bacterium Among Men Develops Antibiotic Resistance
Passenger Partially Pulled Out of Ryanair Jet After Cabin Window Fails Mid-Flight
Severe Heatwave Drives Dangerous Ground-Level Ozone Pollution Across Two Thirds of European Union
The Physical and Electronic Barriers Disrupting Domestic Wireless Networks
France and Morocco Open World Cup Quarter-Finals as Collina Defends Refereeing
×