Budapest Post

Cum Deo pro Patria et Libertate
Budapest, Europe and world news

Facebook content moderators sue over psychological trauma

Facebook content moderators sue over psychological trauma

In the summer of 2017, Chris Gray walked into Facebook’s Dublin office for his first day of work as a content moderator.

“It's one of these very trendy, California-style open offices. Bright yellow emojis painted on the wall,” Gray said. “It's all very pretty, very airy, seems very cool.”

Gray wasn’t a Facebook employee. He was a contractor hired by CPL Resources PLC in Dublin, one of several outsourcing firms Facebook works with to moderate content on its platform. He took the job hoping to move up the ranks and eventually work for Facebook. But that never happened. Instead, Gray says, the nine months he spent at CPL Resources left him with lasting psychological trauma and post-traumatic stress disorder (PTSD).

Gray and several other former contractors are now suing CPL Resources and Facebook in Ireland’s High Court over the psychological trauma they say they endured because of poor training and lack of adequate mental health resources on the job. The lawsuit, which was filed last week, is bringing new scrutiny to the content moderation ecosystem that Facebook and other platforms rely on to police what gets posted on their platforms.

Gray started working as a content moderator in July 2017. He was one of the thousands hired to moderate flagged content on Facebook following a series of high-profile incidents. In April 2017, a Cleveland, Ohio man uploaded a video of himself gunning down an elderly stranger on the street. It stayed on Facebook for hours. Within days, a man in Thailand livestreamed the murder of his baby daughter on Facebook Live.

Facebook was scrambling to prove it was taking steps to keep posts like this off the site and in May, Facebook CEO Mark Zuckerberg announced his company would be adding 3,000 new members to the team of people who moderate content for Facebook. (Today, there are about 15,000 people around the world who review content for Facebook, according to a company spokesperson.)

Related: Facebook wants to create a 'Supreme Court' for content moderation. Will it work?

At first, Gray’s job was to keep pornography off the site. When a user or Facebook’s technology flagged a post that seemed to be in violation of Facebook’s “Community Standards,” it would go to Gray, or to someone else on his team who would review the video, photo or text and decide what to do with it - take it down, mark it with a warning or leave it up.

“After a few months, I was moved to the high-priority queue, which is hate speech, graphic violence, bullying. Really all the nasty stuff you want to act on very quickly,” Gray said. “I really don't like to talk in detail about [the things I was reviewing, but it included] executions. Terrorists beheading people. Ethnic cleansing in Myanmar. Bestiality. I mean, you name it. All the worst of humanity, really.”

On busy days, Gray would walk into work to find 800 of these posts waiting in his queue. On good days, it was closer to 200. He had to sift through quickly, but also carefully because Facebook was auditing the decisions he was making - and keeping a score. Gray was working 37.5 hours a week, making about $14 per hour.

Gray was under a strict nondisclosure agreement and therefore was not speaking with friends and family about the disturbing things he was seeing at work. It wasn't until a whole year after he left the company during a meeting with a journalist at a coffee shop that Gray says he opened up about the work he did for Facebook.

“This was the first time I'd ever talked about all the horrible stuff I had to see. I never even discussed it with my wife. And I literally broke down and cried in a coffee shop. And I was absolutely shocked. I was bewildered. I just did not know what was happening to me,” he said.

This incident prompted Gray to go see a doctor. He was diagnosed with PTSD.

CPL Resources did not respond to several interview requests on the lawsuit.

Through a statement provided to The World, Facebook wrote, “We recognize this review work can be difficult, and we work closely with our partners to ensure that the people who do this work are supported. We require everyone who reviews content for Facebook go through an in-depth, multi-week training program on our Community Standards and have access to extensive psychological support to ensure their wellbeing.

“This includes 24/7, on-site support with trained practitioners, an on-call service, and access to private healthcare from the first day of employment. We are also employing technical solutions to limit their exposure to graphic material as much as possible. This is an important issue, and we are committed to getting this right.”

Sean Burke, another former contractor who is suing, says that he did not receive the training and support Facebook claims its partners provide to workers. Burke started working for CPL Resources in 2017.

“On the first day, one of my first tickets was watching someone being beaten to death with a plank of wood with nails on it,” he said. “Within my second week on the job, it was my first time ever seeing child porn.”

Burke says he saw videos of people being decapitated and people committing suicide. Not everything he was reviewing was this disturbing, but these posts stuck with him.

Burke was working the night shift. He'd come in to hundreds of posts every day. Do his work, get home around 3 or 4 in the morning, and try to get some sleep. When he finally did, he'd have nightmares about the things he saw on his computer screen at work.

“You're seeing the worst that humanity has to offer, and you just become completely disheartened,” he said.

Burke felt like he needed help and support, so he paid a visit to the CPL Resources’ Wellness Center. They offered yoga, finger-painting classes, and people he could talk to.

“Unfortunately…they can't do anything to help you cope or manage with the material or the environment,” Burke said. “They're kind of just, there's a shoulder to lean [on] and cry on.”

Burke sought outside help and was prescribed anxiety medication, which he says helped him cope. But his accuracy rating fell below 98, and CPL Resources did not extend his contract. (Remember, every decision he made was audited to assess whether he did a good enough job applying Facebook's rules - rules that Burke says were complicated and constantly evolving).

Facebook has said it wants to eventually automate most of this crucial content moderation work - to have it done by sophisticated algorithms. But the technology isn't there yet. In the meantime, Cori Crider, who’s with the London-based nonprofit Foxglove, and is assisting with the lawsuit, says she wants better conditions for the humans doing the work.

Facebook and other social media platforms could not exist without the labor that these people provide,” she said. “It would be unusable. You wouldn't touch it. You wouldn't set foot in it because it would just be awash in abuse and pornography and violence. And the people who are on the front lines of this battle making the platforms a place that's [usable] for us all - they're really paying the price right now.”

Crider wants Facebook and its partners to provide better mental health support to employees, and to limit how much toxic content moderators are exposed to.

“If you think, for example, about police investigating child abuse cases here in the UK, they all have…very serious psychological support and actually limits on the amount of time they're permitted to be exposed to that stuff,” Crider said. “So, if [Facebook] had just taken a little bit closer look at comparative examples of other people who do this sort of work, they could've done better.”

Gray agrees. But he says that figuring out the best way to keep the internet and the people who moderate it safe is not easy.

“It's an incredibly complex task,” Gray said. “And I don't think Facebook should be ashamed that they haven't got it right yet. I think they just need to say, ‘OK, we're learning. We're doing our best. We've made mistakes. And it appears that some people have suffered as a result of those mistakes. And we're going to make that right.’”

AI Disclaimer: An advanced artificial intelligence (AI) system generated the content of this page on its own. This innovative technology conducts extensive research from a variety of reliable sources, performs rigorous fact-checking and verification, cleans up and balances biased or manipulated content, and presents a minimal factual summary that is just enough yet essential for you to function as an informed and educated citizen. Please keep in mind, however, that this system is an evolving technology, and as a result, the article may contain accidental inaccuracies or errors. We urge you to help us improve our site by reporting any inaccuracies you find using the "Contact Us" link at the bottom of this page. Your helpful feedback helps us improve our system and deliver more precise content. When you find an article of interest here, please look for the full and extensive coverage of this topic in traditional news sources, as they are written by professional journalists that we try to support, not replace. We appreciate your understanding and assistance.
Newsletter

Related Articles

0:00
0:00
Close
Emails Leaked: How Passenger Luggage Became a Side Income for Airport Workers
Polish MEP: “Dear Leftists - China is laughing at you, Russia is laughing, India is laughing”
Western Europe Records Hottest June on Record
BRICS Expands Membership with Indonesia and Ten New Partner Countries
Elon Musk Founds a Party Following a Poll on X: "You Wanted It – You Got It!"
China’s Central Bank Consults European Peers on Low-Rate Strategies
France Requests Airlines to Cut Flights at Paris Airports Amid Planned Air Traffic Controller Strike
Poland Implements Border Checks Amid Growing Migration Tensions
Emirates Airline Expands Market Share with New $20 Million Campaign
Amazon Reaches Milestone with Deployment of One Millionth Robot
Yulia Putintseva Calls for Spectator Ejection at Wimbledon Over Safety Concerns
House Oversight Committee Subpoenas Former Jill Biden Aide Amid Investigation into Alleged Concealment of President Biden's Cognitive Health
Amazon Reaches Major Automation Milestone with Over One Million Robots
Extreme Heat Wave Sweeps Across Europe, Hitting Record Temperatures
Meta Announces Formation of Ambitious AI Unit, Meta Superintelligence Labs
Robots Compete in Football Tournament in China Amid Injuries
China Unveils Miniature Insect-Like Surveillance Drone
Marc Marquez Claims Victory at Dutch Grand Prix Amidst Family Misfortune
Germany Votes to Suspend Family Reunification for Asylum Seekers
Budapest Pride Parade Draws 200,000 Participants Amid Government Ban
Southern Europe Experiences Extreme Heat
Xiaomi's YU7 SUV Launch Garners Record Pre-Orders Amid Market Challenges
Jeff Bezos and Lauren Sanchez's Lavish Wedding in Venice
Russia Launches Largest Air Assault on Ukraine Since Invasion
Massive Anti-Government Protests Erupt in Belgrade
Iran Executes Alleged Israeli Spies and Arrests Hundreds Amid Post-War Crackdown
Hungary's Prime Minister Criticizes NATO's Role in Ukraine
EU TO HUNGARY: LET THEM PRIDE OR PREP FOR SHADE. ORBÁN TO EU: STAY IN YOUR LANE AND FIX YOUR OWN MESS.
Hungarian Scientist to Conduct 30 Research Experiments on the International Space Station
NATO Members Agree to 5% Defense Spending Target by 2035
NATO Leaders Endorse Plan for Increased Defence Spending
U.S. Crude Oil Prices Drop Below $65 Amid Market Volatility
International Astronaut Team Launched to Space Station
Macron and Merz: Europe must arm itself in an unstable world
Germany and Italy Under Pressure to Repatriate $245bn of Gold from US Vaults
Iran Intensifies Crackdown on Alleged Mossad Operatives After Sabotage Claims
Trump Praises Iran’s ‘Very Weak’ Response After U.S. Strikes and Presses Israel to Pursue Peace
Oil Prices Set to Surge After US Strikes Iran
BA and Singapore Airlines Cancel Dubai Flights Amid Middle East Tensions
Trump Faces Backlash from MAGA Base Over Iran Strikes
Meta Bets $14 B on Alexandr Wang to Drive AI Ambitions
FedEx Founder Fred Smith, ‘Heart and Soul’ of the Company, Dies at 80
Chinese Factories Shift Away from U.S. Amid Trump‑Era Tariffs
Pimco Seizes Opportunity in Japan’s Dislocated Bond Market
Labubu Doll Drives Pop Mart to Status as China’s Most Valuable Toy Maker
Global Coal Demand Defies Paris Accord Goals
United States Conducts Precision Strikes on Iran’s Nuclear Sites
US strikes Iran nuclear sites, Trump says
Telegram Founder: I Will Leave My Fortune to Over 100 of My Children
16 Billion Login Credentials Leaked in Unprecedented Cybersecurity Breach
×