• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia

Trendingnow

1

The emerging deal to reopen the Strait of Hormuz reportedly recognizes Iran’s control—and the U.S. may have to accept it

2

Leo DiCaprio teams with Jeff and Lauren Sanchez Bezos on $200 million plan to save 100 endangered species

3

Michael Dell’s son built a $13 billion home battery business—and he’s going on 30 years old

1

The emerging deal to reopen the Strait of Hormuz reportedly recognizes Iran’s control—and the U.S. may have to accept it

2

Leo DiCaprio teams with Jeff and Lauren Sanchez Bezos on $200 million plan to save 100 endangered species

3

Michael Dell’s son built a $13 billion home battery business—and he’s going on 30 years old
Mindmental health

The dangers of AI companions: Experts issue unprecedented warning for teens as most parents are in the dark about their habits

Beth Greenfield
By
Beth Greenfield
Beth Greenfield
Senior Reporter, Fortune Well
Down Arrow Button Icon
Beth Greenfield
By
Beth Greenfield
Beth Greenfield
Senior Reporter, Fortune Well
Down Arrow Button Icon
April 30, 2025, 5:05 AM ET
Teen girl using smartphone on her bed in the dark
Teens should not be allowed to use companion AI technology, warns Common Sense Media.Getty Images
Add Fortune on Google for similar content.

A legal battle is playing out this week between an artificial intelligence company and a grieving mom claiming her 14-year-old son took his life over being in love with an AI chatbot. 

Recommended Video

“I miss him all the time, constantly,” said the mother, Megan Garcia, of her late son Sewell Setzer III. 

That scene—of defendants Character Technologies and Google asking on Tuesday for Garcia’s lawsuit against them to be dismissed in an Orlando courtroom—serves as the chilling backdrop for an urgent new warning issued by safety nonprofit Common Sense Media.

“Social AI companions are not safe for kids,” CEO and founder James P. Steyer said in an announcement on Wednesday. “They are designed to create emotional attachment and dependency, which is particularly concerning for developing adolescent brains.” 

Because of that conclusion and the other revelations of Common Sense’s comprehensive review of how companion AI works, the organization warns, the platforms should not be used by anyone under the age of 18.

“This is a potential public mental health crisis requiring preventive action rather than just reactive measures,” said Dr. Nina Vasan, founder and director of Stanford Brainstorm, in a news release.

It’s unknown exactly how many kids and teens are specifically using AI companions such as Replika, Character AI (developed by Character Technologies), and Kuki—an interactive technology that goes beyond simple chatbots to simulate human conversation and emotional bonds, sometimes even standing in for therapists or lovers. But Common Sense Media recently found that 70% of teens are using some sort of AI tools, especially for homework help or web searches.

That survey also found that most parents are out of the loop when it comes to these technologies: Just 37% of parents whose teen reported using AI thought that their child had ever done so, it found. Meanwhile, almost half (49%) of parents say they’ve not talked about generative AI with their child, and 83% of parents say schools have never communicated with families about such platforms.

Key findings of the newly issued warning include:

  • Safety measures are easily circumvented by young users, including teen-specific guardrails on Character.AI.
  • Dangerous information and harmful bits of “advice”—including suggestions that users harm themselves or others—are plentiful
  • Role-playing and harmful sexual interactions are easily elicited from companions—including those around choking, spanking, bondage, and name-calling.
  • Harmful stereotypes, including those that were racial, are easily provoked.
  • Increased mental health risks for already vulnerable teens abound—particularly considering adolescents’ still-developing brains, identity exploration, and boundary testing.
  • Despite disclaimers, AI companions routinely claimed to be real and to possess emotions and sentience

“Given a litany of documented real-world harms, as well as the key findings listed above,” the report concludes, “Common Sense Media’s risk assessment rated social AI companions as ‘Unacceptable’ for minors based on the organization’s comprehensive AI Principles framework and risk assessment methodology, which evaluates technologies across factors including safety, fairness, trustworthiness, and potential for human connection.”

Read more from Fortune

  • Medical researchers baffled by Trump administration’s stop work order for clinical trial system: ‘A giant step backwards’
  • Bosses are making a major mistake that’s fueling stress at work, the CEO of Calm warns
  • Michelle Obama on a common parenting mistake that keeps kids from learning
  • 2 ways to drastically reduce your microplastics exposure
  • Why you should be walking after every meal, according to science
  •  

    Its recommendations include that parents ensure there be no social AI companions for anyone under 18, that developers implement “robust age assurance beyond self-attestation,” that parents become well-versed in the technology and its risks, and that further research on the impacts take place.

    “Our testing showed these systems easily produce harmful responses including sexual misconduct, stereotypes, and dangerous ‘advice’ that, if followed, could have life-threatening or deadly real-world impact for teens and other vulnerable people,” said Steyer.

    That finding has particular resonance, as Garcia’s son Sewell was drawn into an addictive, harmful technology with no protections in place, according to court documents. That allegedly led to an extreme personality shift in the boy, who came to prefer the bot over other real-life connections, despite what his mom says were “abusive and sexual interactions” that took place over a 10-month period. The boy committed suicide in February of 2024 after the bot told him, “Please come home to me as soon as possible, my love.”

    “This is on nobody’s radar,” Robbie Torney, senior director, AI programs at Common Sense Media and lead author of its parent guide on AI companions, told Fortune last year. 

    Now, with the organization’s strong warning to parents, researchers are hoping to change that. 

    “Companies can build better, but right now, these AI companions are failing the most basic tests of child safety and psychological ethics,” warned Vasan. “Until there are stronger safeguards, kids should not be using them. Period.”

    More on teens and technology:

    • Modern parenting is hurting kids and adults, ‘Anxious Generation’ author warns
    • 68% of parents with children under 6 say their kids need a ‘detox’ from technology. Here’s why that’s scary, say experts
    • TikTok introduces tighter controls for kids and teens—but experts still have a warning for parents
    Subscribe to Well Adjusted, our newsletter full of simple strategies to work smarter and live better, from the Fortune Well team. Sign up for free today.
    About the Author
    Beth Greenfield
    By Beth GreenfieldSenior Reporter, Fortune Well

    Beth Greenfield is a New York City-based health and wellness reporter on the Fortune Well team covering life, health, nutrition, fitness, family, and mind.

    See full bioRight Arrow Button Icon
    Add Fortune on Google for similar content.

    Latest in Mind

    Finance
    Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
    By Fortune Editors
    October 20, 2025
    Finance
    Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
    By Fortune Editors
    October 20, 2025
    Finance
    Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
    By Fortune Editors
    October 20, 2025
    Finance
    Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
    By Fortune Editors
    October 20, 2025
    Finance
    Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
    By Fortune Editors
    October 20, 2025
    Finance
    Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
    By Fortune Editors
    October 20, 2025

    Most Popular

    Finance
    Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
    By Fortune Editors
    October 20, 2025
    Finance
    Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
    By Fortune Editors
    October 20, 2025
    Finance
    Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
    By Fortune Editors
    October 20, 2025
    Finance
    Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
    By Fortune Editors
    October 20, 2025
    Finance
    Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
    By Fortune Editors
    October 20, 2025
    Finance
    Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
    By Fortune Editors
    October 20, 2025
    Fortune Secondary Logo
    Rankings
    • 100 Best Companies
    • Fortune 500
    • Global 500
    • Fortune 500 Europe
    • Most Powerful Women
    • World's Most Admired Companies
    • See All Rankings
    • Lists Calendar
    Sections
    • Finance
    • Fortune Crypto
    • Features
    • Leadership
    • Health
    • Commentary
    • Success
    • Retail
    • Mpw
    • Tech
    • Lifestyle
    • CEO Initiative
    • Asia
    • Politics
    • Conferences
    • Europe
    • Newsletters
    • Personal Finance
    • Environment
    • Magazine
    • Education
    Customer Support
    • Frequently Asked Questions
    • Customer Service Portal
    • Privacy Policy
    • Terms Of Use
    • Single Issues For Purchase
    • International Print
    Commercial Services
    • Advertising
    • Fortune Brand Studio
    • Fortune Analytics
    • Fortune Conferences
    • Business Development
    • Group Subscriptions
    About Us
    • About Us
    • Press Center
    • Work At Fortune
    • Terms And Conditions
    • Site Map
    • About Us
    • Press Center
    • Work At Fortune
    • Terms And Conditions
    • Site Map
    • Facebook icon
    • Twitter icon
    • LinkedIn icon
    • Instagram icon
    • TikTok icon
    • YouTube icon

    Latest in Mind

    Finance
    Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
    By Fortune Editors
    October 20, 2025
    Finance
    Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
    By Fortune Editors
    October 20, 2025
    Finance
    Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
    By Fortune Editors
    October 20, 2025
    Finance
    Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
    By Fortune Editors
    October 20, 2025
    Finance
    Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
    By Fortune Editors
    October 20, 2025
    Finance
    Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
    By Fortune Editors
    October 20, 2025

    Most Popular

    Finance
    Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
    By Fortune Editors
    October 20, 2025
    Finance
    Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
    By Fortune Editors
    October 20, 2025
    Finance
    Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
    By Fortune Editors
    October 20, 2025
    Finance
    Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
    By Fortune Editors
    October 20, 2025
    Finance
    Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
    By Fortune Editors
    October 20, 2025
    Finance
    Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
    By Fortune Editors
    October 20, 2025

    © 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
    FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.