• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia
TechGoogle

Google Images Adds More Artificial Intelligence to Improve its Vision

By
Jonathan Vanian
Jonathan Vanian
Down Arrow Button Icon
By
Jonathan Vanian
Jonathan Vanian
Down Arrow Button Icon
October 25, 2018, 9:00 AM ET

Google Images is getting a big upgrade that is based on artificial intelligence.

Google said Thursday that it started introducing a new feature for smartphone users that lets them search for specific objects within photos, like a flower bouquet in a wedding portrait. All users have to do is trace a finger around that bouquet to find similar looking bouquets that could be linked to outside sources like floral sites and interior design blogs.

It’s part of a broader initiative by Google to develop more ways for people to search for information beyond entering words and text into the company’s core search engine, explained Google Images engineering head Cathy Edwards.

The revamped Google Images is now powered by the company’s Lens technology that it unveiled in 2017 and embedded in products like its Google Photos mobile phone app that people use to store their digital photos. The Lens technology, derived from the company’s various deep learning projects that teach computers to recognize objects in photos, can tell people what breed of dog their beloved pooch may be by scanning their pet photos.

Now Google has added Lens technology to Google Images to make it easier for people to search for specific images, Edwards explained.

Users will now see a small lens-shaped icon below the photos they chose to access from Google Images. Pressing the lens icon triggers several smaller dots to appear over objects in the photo that the tech recognizes, and touching one of those overlaid dots will produce other similar photos of the objects from around the web.

People can also use their fingers to trace over areas within photos that contain objects they want the tech to recognize and scour the web for. If users search for Oscar dresses, for instance, they can use their fingers to circle an actress’ shoes, which should retrieve images of similar looking footwear.

The goal is to give Google Images users something else to do besides merely stare at the photos that happen to show up in a search query. It’s also a way to try to keep Google Images competitive amid the rise of social photo sites like Facebook’s Instagram and Pinterest, both of which created ways for people to do more things when perusing their services, like visiting retail sites that may sell sneakers shown in certain photos.

Some users consult Google Images for ideas about do-it-yourself home projects, while others want to see photos of car engines to help with their auto repairs, Edwards said.

“We have an enormous number of queries for people who want to fix their cars and they want to identify car parts,” she said.

Although the new feature should be able to identify basic objects in photos, over time it should be able to identify more advanced things like specific types of flowers and noteworthy landmarks, she said. The new feature, however, won’t work with controversial content like pornography, she explained.

Still, adding more features to Google Images opens the company up to potential problems with its AI technologies. In 2015, for instance, Google Photos was heavily criticized for labeling African-Americans as gorillas, underscoring problems with artificial intelligence understanding what’s in a photo and inadvertent bias in the data used to train the technology.

Get Data Sheet, Fortune’s technology newsletter.

Edwards said that the company has been testing the latest feature for bias, and is using artificial intelligence technology to potentially mitigate problems. The new product is rolling out first in the U.S. and later overseas to work out any potential hiccups.

About the Author
By Jonathan Vanian
LinkedIn iconTwitter icon

Jonathan Vanian is a former Fortune reporter. He covered business technology, cybersecurity, artificial intelligence, data privacy, and other topics.

See full bioRight Arrow Button Icon

Latest in Tech

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • Future 50
  • World’s Most Admired Companies
  • See All Rankings
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Editorial Calendar
  • Press Center
  • Work At Fortune
  • Diversity And Inclusion
  • Terms And Conditions
  • Site Map
  • About Us
  • Editorial Calendar
  • Press Center
  • Work At Fortune
  • Diversity And Inclusion
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • Pinterest icon

Latest in Tech

Bernard Looney, CEO of Prometheus Hyperscale
EnergyBP
Former BP CEO takes over Wyoming data center developer, as first woman leader of Big Oil giant becomes new BP chief
By Jordan BlumMarch 31, 2026
10 hours ago
brian
CommentaryCulture
The real engine of innovation is trust
By Brian DoublesMarch 31, 2026
12 hours ago
artemis
PoliticsNASA
NASA is finally going back to the moon, with Artemis II. What took so long?
By Emily A. Margolis and The ConversationMarch 31, 2026
12 hours ago
The green head of what appears to be an alien pokes out from behind a rock set against a rural landscape with a power pylon in the background.
NewslettersEye on AI
AI’s ability to see ‘mirages’ shows how alien machine brains really are
By Jeremy KahnMarch 31, 2026
13 hours ago
Anthropic mistakenly leaks its own AI coding tool’s source code, just days after accidentally revealing an upcoming model known as Mythos
AIAnthropic
Anthropic mistakenly leaks its own AI coding tool’s source code, just days after accidentally revealing an upcoming model known as Mythos
By Beatrice NolanMarch 31, 2026
13 hours ago
The beauty counter is now on your For You page as Ulta Beauty joins TikTok Shop, betting on the platform reshaping how America consumes
RetailTikTok
The beauty counter is now on your For You page as Ulta Beauty joins TikTok Shop, betting on the platform reshaping how America consumes
By Catherina GioinoMarch 31, 2026
14 hours ago

Most Popular

Jerome Powell says the $39 trillion national debt is ‘not unsustainable,’ but warns the trajectory ‘will not end well’
Economy
Jerome Powell says the $39 trillion national debt is ‘not unsustainable,’ but warns the trajectory ‘will not end well’
By Fortune EditorsMarch 30, 2026
1 day ago
A man used AI to call 3,000 Irish bartenders to track the cost of Guinness. Now pubs are lowering their prices to compete
AI
A man used AI to call 3,000 Irish bartenders to track the cost of Guinness. Now pubs are lowering their prices to compete
By Fortune EditorsMarch 30, 2026
2 days ago
Markets cheer as Trump threatens to abandon Iran war, but Jamie Dimon sides with allies: ‘Win this thing and clean up the straits’
Energy
Markets cheer as Trump threatens to abandon Iran war, but Jamie Dimon sides with allies: ‘Win this thing and clean up the straits’
By Fortune EditorsMarch 31, 2026
17 hours ago
The federal government shed 385,000 employees last year. Now the Trump administration is on a blitz to hire Gen Z workers
Politics
The federal government shed 385,000 employees last year. Now the Trump administration is on a blitz to hire Gen Z workers
By Fortune EditorsMarch 31, 2026
1 day ago
A CEO trying to reindustrialize America says blue-collar pay is headed for 'massive hyperinflation' and kids should skip college to become welders
Success
A CEO trying to reindustrialize America says blue-collar pay is headed for 'massive hyperinflation' and kids should skip college to become welders
By Fortune EditorsMarch 30, 2026
2 days ago
Current price of gold as of March 30, 2026
Personal Finance
Current price of gold as of March 30, 2026
By Fortune EditorsMarch 30, 2026
2 days ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.