• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia
Tech

‘This Is an Arms Race.’ Why Facebook Isn’t Winning Its War on Harmful Content—Yet

By
Danielle Abril
Danielle Abril
Down Arrow Button Icon
By
Danielle Abril
Danielle Abril
Down Arrow Button Icon
April 11, 2019, 6:49 PM ET

Facebook says its latest updates to News Feed, Messenger, and Instagram will help it battle misinformation and harmful content. While the new features incrementally turn the dial, don’t expect them to end fake news entirely.

Facebook detailed its new rollouts at a press briefing on Wednesday at its Menlo Park headquarters. To combat bad actors and fake news, the social network is introducing several new measures. It’s starting by limiting the reach of groups that repeatedly spread misinformation. With a new measurement called the “Click-Gap,” Facebook says it’s also getting better at identifying click-bait. And the social network is expanding the amount of content that will be fact-checked by the Associated Press. In addition, Messenger users will be able to get a verified badge, helping to combat impersonation, and Instagram posts deemed inappropriate will become harder to find.

These measures are meant to clean up the darker corners of Facebook’s social media empire. In recent years, the company has been heavily scrutinized for how it managed misinformation and harmful content. For example, it hosted live streams of the New Zealand mass shooting in March. It has helped the spread of misinformation and hate speech that encouraged people to kill Muslims, creating chaos in Sri Lanka in March 2018. And it exposed user information to political firm Cambridge Analytica, which used the data to influence the 2016 presidential election.

While Facebook’s latest efforts aim to prevent future incidents like these, the company admits it still faces numerous challenges in fighting the spread fake news.

“We’re up against adversaries,” Guy Rosen, Facebook’s vice president of integrity. “This is an arms race.”

But a few things handicap Facebook in its efforts to improve the integrity of its network.

First, the company takes a hands-off approach when it comes to removing misinformation. Facebook wants to provide users a place to openly express themselves and share information, regardless of its merit, and it’s relatively picky about what it considers harmful and worth removal.

Posts that don’t follow its community standards—like threats of physical harm, hate speech, violence, and sexual activity—are removed. Beyond that, it will take down posts that provide misinformation about elections or increase the risk of eminent violence in specific regions of the world.

But the company doesn’t remove information from Facebook just because it’s false, says Tessa Lyons, head of news feed integrity. As a result, posts containing scientifically debunked anti-vaccination claims remain on the platform—though their reach is diminished, reports WIRED.

To proactively identify potentially harmful posts in the massive amounts of content posted on Facebook every day, the company uses artificial intelligence. But, Facebook’s A.I. can be tricked—another handicap in its arms race.

When harmful content is published, A.I. quickly identifies and removes copies—often before anyone has seen it. But if the content is slightly modified, it sometimes can go undetected by the system. That was the case with the New Zealand shooting, as 300,000 videos of the 1.5 million published were not blocked from being posted.

This shortfall is why Facebook also relies heavily on help from content reviewers, human contract workers who physically review problematic posts. Vendors like Cognizant, Telus International, and Accenture provide a workforce of 15,000 content moderators to Facebook in 20 locations around the world.

But another handicap for Facebook is just how overwhelming this content can be. Given the A.I. detection’s shortcomings, contractors are sometimes left to review the same slightly modified graphic content over and over again, decreasing the ground they can cover and exposing them to possible traumatic effects.

Wednesday’s Facebook briefing showed that though it is is attempting to shore up the integrity of its network, it still has many more battles to win before it can come close to declaring a victory against misinformation.

About the Author
By Danielle Abril
See full bioRight Arrow Button Icon

Latest in Tech

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • World's Most Admired Companies
  • See All Rankings
  • Lists Calendar
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • Pinterest icon

Latest in Tech

OpenAI CEO Sam Altman says Gen Z and millennials are using ChatGPT like a ‘life advisor’—but college students might be one step ahead
TechOpenAI
OpenAI CEO Sam Altman says Gen Z and millennials are using ChatGPT like a ‘life advisor’—but college students might be one step ahead
By Sydney LakeMay 10, 2026
36 minutes ago
Torsten Slok, wearing a suit, speaks on a stage with a gold and black background.
AILabor
‘The gains will be substantial’: The AI shock is looking a lot like the China shock, and a top economist says that’s actually good news
By Sasha RogelbergMay 10, 2026
2 hours ago
Young man working on laptop with headphones in modern coffeeshop
Future of Workskills gap
AI generated identical résumés for a man and a woman: Hers was more likely to be labeled ‘weak,’ while his got a 97% approval rating
By Eleanor PringleMay 10, 2026
5 hours ago
UFO files show Buzz Aldrin saw a ‘sizeable’ object close to the moon and a ‘fairly bright light source’ that the Apollo 11 crew felt could be a laser
Innovationspace
UFO files show Buzz Aldrin saw a ‘sizeable’ object close to the moon and a ‘fairly bright light source’ that the Apollo 11 crew felt could be a laser
By Seung Min Kim, Collin Binkley and The Associated PressMay 9, 2026
22 hours ago
joaquin
Commentary250 Years of Innovation
Johnson & Johnson CEO: America’s innovation advantage starts with health 
By Joaquin DuatoMay 9, 2026
1 day ago
Qualcomm’s CEO is working with ‘pretty much all’ major AI players on top-secret devices—and powering OpenAI’s first push into hardware
AIQualcomm
Qualcomm’s CEO is working with ‘pretty much all’ major AI players on top-secret devices—and powering OpenAI’s first push into hardware
By Eva RoytburgMay 9, 2026
1 day ago

Most Popular

'Employers are increasingly turning to degree and GPA' in hiring: Recruiters retreat from ‘talent is everywhere,’ double down on top colleges
Future of Work
'Employers are increasingly turning to degree and GPA' in hiring: Recruiters retreat from ‘talent is everywhere,’ double down on top colleges
By Jake AngeloMay 9, 2026
23 hours ago
Ted Cruz says the quiet part out loud: Trump accounts are Social Security personal accounts as GOP senator reveals 'dirty little secret'
Politics
Ted Cruz says the quiet part out loud: Trump accounts are Social Security personal accounts as GOP senator reveals 'dirty little secret'
By Jason MaMay 9, 2026
19 hours ago
Red flag test: former CEO explains why he rejects job candidates who say they can start right away
Success
Red flag test: former CEO explains why he rejects job candidates who say they can start right away
By Orianna Rosa RoyleMay 9, 2026
1 day ago
You're probably safe from the Hantavirus outbreak, but here's what you absolutely must not do, experts say
Politics
You're probably safe from the Hantavirus outbreak, but here's what you absolutely must not do, experts say
By Catherina GioinoMay 8, 2026
2 days ago
Companies are abandoning 'peanut butter' raises as pay-for-performance takes over the workplace in the AI era
Future of Work
Companies are abandoning 'peanut butter' raises as pay-for-performance takes over the workplace in the AI era
By Marco Quiroz-GutierrezMay 9, 2026
1 day ago
A Michigan farm town voted down plans for a giant OpenAI-Oracle data center. Weeks later, construction began
Magazine
A Michigan farm town voted down plans for a giant OpenAI-Oracle data center. Weeks later, construction began
By Sharon GoldmanMay 6, 2026
4 days ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.