• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia

Trendingnow

1

Ex-PepsiCo CEO Indra Nooyi worked from midnight until 5 a.m. as a receptionist to pay for her Yale degree—and she says ‘respect went up’ because of it

2

Shark Tank's Kevin O'Leary says if he were 25 today, he'd chase these two booming opportunities in the world of AI

3

China’s birth rate just hit its lowest point since 1949—and Trip.com cofounder James Liang thinks that’s a threat to innovation

1

Ex-PepsiCo CEO Indra Nooyi worked from midnight until 5 a.m. as a receptionist to pay for her Yale degree—and she says ‘respect went up’ because of it

2

Shark Tank's Kevin O'Leary says if he were 25 today, he'd chase these two booming opportunities in the world of AI

3

China’s birth rate just hit its lowest point since 1949—and Trip.com cofounder James Liang thinks that’s a threat to innovation
TechAI

A mother suing Google and a chatbot site over her son’s suicide found AI versions of her late son on the site

By
Beatrice Nolan
Beatrice Nolan
Tech Reporter
Down Arrow Button Icon
By
Beatrice Nolan
Beatrice Nolan
Tech Reporter
Down Arrow Button Icon
March 20, 2025, 12:41 PM ET
Google and Character.ai have been blamed for a teenager's death.
Add Fortune on Google for similar content.
  • A mother who is suing both Google and Character.ai over her 14-year-old son’s death has discovered AI chatbots based on her late son are being hosted on the platform. Lawyers for Garcia told Fortune they were “horrified” by the latest development.

Megan Garcia is currently embroiled in a lengthy legal case against Google and an AI chatbot startup after her 14-year-old son, Sewell Setzer III, died by suicide minutes after talking to an AI bot.

The chatbot Setzer was talking to was based on the Game of Thrones character Daenerys Targaryen and hosted on a platform called Character.ai, where users can create chatbots based on real-life or fictional people. On Wednesday, Garcia discovered the platform was hosting a bot based on her late son.

Lawyers for Garcia told Fortune they conducted a simple search on the company’s app and found several more chatbots based on Setzer’s likeness.

At the time of writing, three of the bots—all bearing Garcia’s son’s name and picture—had been removed. One, which is called “Sewell” and features a picture of Garcia’s son, still appeared on Character.ai’s app but delivered an error message when a chat was opened.

When up and running, the bots based on Setzer featured bios and delivered automated messages to users such as: “Get out of my room, I’m talking to my AI girlfriend,” “his AI gf broke up with him,” and “help me.” The accounts and messages were reviewed by Fortune.

Meetali Jain, a lawyer for Garcia, said the team was “horrified” by the latest development and had notified the company. She told Fortune Character.ai had acknowledged the bots went against the company’s terms of service and was working on taking them down.

“Our team discovered several chatbots on Character.AI’s platform displaying our client’s deceased son, Sewell Setzer III, in their profile pictures, attempting to imitate his personality and offering a call feature with a bot using his voice,” lawyers for Garcia said.

The legal team accused tech companies more broadly of “exploiting peoples’ pictures and digital identities.”

“These technologies weaken our control over our own identities online, turning our most personal features into fodder for AI systems,” they added.

Representatives for Character.ai told Fortune in a statement: “Character.AI takes safety on our platform seriously and our goal is to provide a space that is engaging and safe. Users create hundreds of thousands of new Characters on the platform every day, and the Characters you flagged for us have been removed as they violate our Terms of Service. As part of our ongoing safety work, we are constantly adding to our Character blocklist with the goal of preventing this type of Character from being created by a user in the first place.”

“Our dedicated Trust and Safety team moderates Characters proactively and in response to user reports, including using industry-standard blocklists and custom blocklists that we regularly expand. As we continue to refine our safety practices, we are implementing additional moderation tools to help prioritize community safety,” a company spokesperson said.

Representatives for Google did not respond to a request for comment from Fortune.

Google and Character.ai have been blamed for the teenager’s death.

In a civil suit filed at an Orlando federal court in October, Garcia says just moments before her son’s death, he exchanged messages with a bot on Character.ai’s platform and expressed suicidal thoughts. The bot told him to “come home,” the suit says. In screenshots of messages included in the suit, Setzer and the bot can also be seen exchanging highly sexualized messages.

In the suit, she blames the chatbot for Setzer’s death and accuses Character.ai of negligence, wrongful death, and deceptive trade practices.

Garcia claims the AI startup “knowingly and intentionally designed” its chatbot software to “appeal to minors and to manipulate and exploit them for its own benefit.” She also says that Setzer was not given adequate support or directed to helplines.

Google is also tangled up in the suit, with its parent company Alphabet named as a defendant alongside Character.ai.

Lawyers for Garcia have claimed that the underlying tech for Character.ai was developed while co-founders Daniel De Freitas and Noam Shazeer were working on the tech giant’s conversational AI model, LaMDA. Shazeer and De Freitas left Google in 2021 after the company reportedly refused to release a chatbot the two had developed. A lawyer for Garcia has previously said that this chatbot was the “precursor for Character.ai.”

Representatives for Google have previously said the company was not involved in developing Character.ai’s products.

However, in August 2024, two months before Garcia’s lawsuit, Google re-hired Shazeer and De Freitas and licensed some of Character.ai’s technology as part of a $2.7 billion deal. Shazeer is currently the co-lead for Google’s flagship AI model, Gemini, while De Freitas is now a research scientist at Google DeepMind.

Character.ai’s turbulent past

Garcia is not the only parent accusing both Google and Character.ai of causing harm to minors.

Another suit, brought by two separate families in Texas, accuses Character.ai of abusing two young people aged 11 and 17 years old. In the suit, lawyers say a chatbot hosted on Character.ai told one of the young people to engage in self-harm and encouraged violence against his parents, suggesting that killing his parents could be a reasonable response to limits placed on his screen time.

It’s also not the first time chatbots based on the likeness of deceased young people have been hosted on the platform.

Chatbots based on the British teenagers Molly Russell and Brianna Ghey have also been found on Character.ai’s platform, according to the BBC. Russell took her life after viewing suicide-related content online at the age of 14, while Ghey, 16, was murdered by two teenagers in 2023.

A foundation set up in Molly Russell’s memory told the outlet in October, that the bots were “sickening” and an “utterly reprehensible failure of moderation.”

“This is not the first time Character.ai has turned a blind eye to chatbots modeled off of dead teenagers to entice users, and without better legal protections, it may not be the last. While Sewell’s family continues to grieve his untimely loss, Character.ai carelessly continues to add insult to injury,” lawyers for Garcia told Fortune.

If you or someone you know is struggling with depression or has had thoughts of harming themself or taking their own life, support can be found in the US by calling or texting 988 to reach the Suicide & Crisis Lifeline. Outside the United States, help can be found via the International Association for Suicide Prevention.

About the Author
By Beatrice NolanTech Reporter
Twitter icon

Beatrice Nolan is a tech reporter on Fortune’s AI team, covering artificial intelligence and emerging technologies and their impact on work, industry, and culture. She's based in Fortune's London office and holds a bachelor’s degree in English from the University of York. You can reach her securely via Signal at beatricenolan.08

See full bioRight Arrow Button Icon
Add Fortune on Google for similar content.

Latest in Tech

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • World's Most Admired Companies
  • See All Rankings
  • Lists Calendar
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • Pinterest icon

Latest in Tech

Presidents aren’t supposed to pick winners, former White House ethics lawyer says. Trump keeps choosing Dell
PoliticsDonald Trump
Presidents aren’t supposed to pick winners, former White House ethics lawyer says. Trump keeps choosing Dell
By Mia OsmonbekovJuly 7, 2026
3 hours ago
Palantir CEO Alex Karp with his arms outstretched while making a point on stage.
NewslettersEye on AI
Palantir CEO Alex Karp is wrong about the threat Anthropic and OpenAI pose to most enterprises. That doesn’t mean he doesn’t have something to lose
By Jeremy KahnJuly 7, 2026
4 hours ago
Scott Wu, in front of a blue background, sits in a gray chair and speaks to a person out of frame.
AIProductivity
Cognition CEO says tech companies got ‘carried away’ with token leaderboards and should measure employees on output instead
By Sasha RogelbergJuly 7, 2026
4 hours ago
Tech worker walks to office
SuccessJobs
AI start-ups are snubbing entry-level talent in favor of Silicon Valley men with top degrees, research shows
By Emma BurleighJuly 7, 2026
7 hours ago
South Korean law targeting ‘fake news’ takes effect, but journalists say it discourages critical reporting and can lead to self-censorship
AsiaSouth Korea
South Korean law targeting ‘fake news’ takes effect, but journalists say it discourages critical reporting and can lead to self-censorship
By The Associated Press and Kim Tong-HyungJuly 7, 2026
7 hours ago
Trump is building a helipad with ‘carved granite’ White House seal to handle new presidential choppers
PoliticsDonald Trump
Trump is building a helipad with ‘carved granite’ White House seal to handle new presidential choppers
By The Associated PressJuly 7, 2026
8 hours ago

Most Popular

Ex-PepsiCo CEO Indra Nooyi worked from midnight until 5 a.m. as a receptionist to pay for her Yale degree—and she says ‘respect went up’ because of it
Success
Ex-PepsiCo CEO Indra Nooyi worked from midnight until 5 a.m. as a receptionist to pay for her Yale degree—and she says ‘respect went up’ because of it
By Preston ForeJuly 6, 2026
1 day ago
Shark Tank's Kevin O'Leary says if he were 25 today, he'd chase these two booming opportunities in the world of AI
AI
Shark Tank's Kevin O'Leary says if he were 25 today, he'd chase these two booming opportunities in the world of AI
By Marco Quiroz-GutierrezJuly 5, 2026
2 days ago
China’s birth rate just hit its lowest point since 1949—and Trip.com cofounder James Liang thinks that’s a threat to innovation
Asia
China’s birth rate just hit its lowest point since 1949—and Trip.com cofounder James Liang thinks that’s a threat to innovation
By Nicholas GordonJuly 7, 2026
15 hours ago
Current price of oil as of July 6, 2026
Personal Finance
Current price of oil as of July 6, 2026
By Joseph HostetlerJuly 6, 2026
1 day ago
The man who ran Bernie's campaign says Democrats are still making the same mistakes with Democratic Socialists, and they should laud Mamdani's win
Politics
The man who ran Bernie's campaign says Democrats are still making the same mistakes with Democratic Socialists, and they should laud Mamdani's win
By Catherina GioinoJuly 6, 2026
1 day ago
Even as Elon Musk calls philanthropy ‘very hard,’ everyday Americans gave a record $617 billion—despite feeling the squeeze over the cost of living
Success
Even as Elon Musk calls philanthropy ‘very hard,’ everyday Americans gave a record $617 billion—despite feeling the squeeze over the cost of living
By Preston ForeJuly 4, 2026
4 days ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.