• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia

Trendingnow

1

Current price of silver as of Monday, September 8, 2026

2

Current price of oil as of September 8, 2026

3

7 months into Iran War, Trump accuses communists of 'INHUMAN ideology that has led to DEATH and DESTRUCTION around the World!'

1

Current price of silver as of Monday, September 8, 2026

2

Current price of oil as of September 8, 2026

3

7 months into Iran War, Trump accuses communists of 'INHUMAN ideology that has led to DEATH and DESTRUCTION around the World!'
ConferencesBrainstorm Design
Asia

Data activist Renée Cummings says there’s an important question to ask when making responsible AI: ‘Where did this data come from?’

By
Jay Ganglani
Jay Ganglani
Down Arrow Button Icon
By
Jay Ganglani
Jay Ganglani
Down Arrow Button Icon
December 6, 2024, 3:32 AM ET
Renée Cummings, Assistant Professor of the Practice in Data Science, University of Virginia, speaks at Fortune Brainstorm Design on Dec. 5, 2024.
Renée Cummings, Assistant Professor of the Practice in Data Science, University of Virginia, speaks at Fortune Brainstorm Design on Dec. 5, 2024.Lucas Schifres for Fortune
Google source logo
Add Fortune on Google for similar content.

One of AI’s thorniest issues is ensuring the new technology doesn’t end up reflecting all the same biases of its human creators have. Generative AI, trained on massive amounts of data, is compounding the problem, rather than mitigating it, as models deliver answers that align with pervasive prejudices about different races and genders.

Recommended Video

Data activist Renée Cummings, at Fortune’s Brainstorm Design event in Macau on Thursday, argued that the core of the issue is data. “We know that AI is a revolutionary technology, we know that AI is a radical technology, but we have to understand that there is no AI without data,” she said. 

Cummings, a professor of practice in data science at the University of Virginia, examines ethical risks in artificial intelligence and studies how to build a responsible and sustainable AI that can benefit everyone in society, regardless of background. 

For example, a recent United Nations study recently pointed to predictive policing as an example of how racial biases are reproduced through technology. This practice involves making judgments regarding who will commit future crimes and where these incidents may take place. The study warns that predictive policing could further add to problems regarding over-policing communities based on race and ethnicity. 

“We know that data creates very unique challenges when it comes to bias, when it comes to discrimination, when it comes to systemic challenges,” Cummings said. 

“It’s so important when we’re designing to ask ourselves, where did this data come from?” she asked. “Sometimes we’re using data that is being duplicated in very weird ways. Data that’s actually missing critical pieces of the stories that need to be told.”

That means AI designers need to have a heightened sense of “ethical vigilance,” she explained. “We have a responsibility to ensure that we bring a framework to…audit the ways in which we are building models, the ways in which we are building algorithms,” she said. 

AI also brings its share of environmental concerns. The metals used in AI hardware, for instance, can lead to both pollution and soil erosion. “We speak about building a sustainable and resilient future using this technology, but we’ve got to think about the ways in which the environment is also being impacted.”

Due diligence can help AI designers work around these issues. They could design new models while ensuring that concepts such as equity, access, and fairness are respected, yet also in a manner that doesn’t undermine the accuracy, or the validity of data, she said

“How involved are communities in the process? It’s very critical the ways in which we engage communities to design, because we’re realizing that many of our data sets…are creating very critical risks,” she explained. 

AI does have the potential to do “extraordinary things,” Cummings noted. AI tools have led to increased efficiency, reduced costs, and greater convenience. But that only heightens the need to make sure the new technology works in a responsible way.

If AI designers don’t take data equity into account, then “what we are going to create are systems that not only undermine our own progress, but systems that could create situations that undermine the ways in which we move into the future together,” she warned. 

Fortune Daily breaks the traditional barrier between audience and newsroom. The show transforms Fortune’s trusted reporting into actionable, conversational, and entertaining insights for an emerging class of business leaders. Watch here.
About the Author
By Jay Ganglani
See full bioRight Arrow Button Icon
Google source logo
Add Fortune on Google for similar content.

Latest from our Conferences


Most Popular

Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • World's Most Admired Companies
  • See All Rankings
  • Lists Calendar
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • TikTok icon
  • YouTube icon

    Latest from our Conferences


    Most Popular

    © 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
    FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.