• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia

Trendingnow

1

Pentagon accuses Alibaba, Baidu and BYD, three of China's biggest companies, of supporting the Chinese military

2

Analysts expected oil to surge above $200 but China has quietly kept prices half of that—and can’t for much longer

3

Costco CEO Ron Vachris rose from forklift driver to the C-suite without a college degree: ‘Don’t chase a title’ is the career advice that got him there

1

Pentagon accuses Alibaba, Baidu and BYD, three of China's biggest companies, of supporting the Chinese military

2

Analysts expected oil to surge above $200 but China has quietly kept prices half of that—and can’t for much longer

3

Costco CEO Ron Vachris rose from forklift driver to the C-suite without a college degree: ‘Don’t chase a title’ is the career advice that got him there
TechAdvertising

Now Advertisers Can Watch You Watch TV

By
Hilary Brueck
Hilary Brueck
Down Arrow Button Icon
By
Hilary Brueck
Hilary Brueck
Down Arrow Button Icon
February 13, 2016, 2:30 PM ET
87301848
Photograph by Getty Images/Image Source

Last fall, as people around the world stared into their computer screens, the British Broadcasting Corporation was staring right back.

The company was checking out the expressions on people’s faces as they read advertisements online. Using webcams, the company scanned 5,153 study participants’ for happiness, sadness, fear, surprise, puzzlement, and rejection of online ads.

Why bother to get the cameras involved? Marketers want to get a more accurate picture for how advertising really makes people feel. Instead of just asking focus groups how they feel, or what they think, they’re going straight to the subconscious source, and watching faces react in real time.

Of course, our human emotions are more complicated than a few smiles and frowns. Andrew Tenzer, senior research manager at BBC Global News says he knows that. A face of “puzzlement” could mean something is intriguing, or it might just be an indication that a person is deep in thought. But Tenzer also says unlike traditional survey and questionnaire results, “our face never lies.”

Using the six basic emotions to track expressions on people’s faces, the BBC marketing team found a few key ways to make text-based online ads more successful. The new research, published online in January, found, not surprisingly, that people don’t like to be tricked into reading ads that look like a news article, for example. But participant faces registered much less “rejection” when those same ads were clearly labeled.

In the past, the BBC has used its facial recognition technology, built by in-house startup CrowdEmotion, to track 4,500 faces as people watched show trailers to see what kinds of emotions the commercials produced. They’ve also looked at how hundreds of study participants react to programs like Top Gear and Sherlock.

Get Data Sheet, Fortune’s technology newsletter.

“Using CrowdEmotion’s emotional intelligence platform, broadcasters can find out exactly what an audience thought about a programme instead of being fed skewed data by respondents trying to give the right answer,” CrowdEmotion wrote in a release.

Facial recognition software like CrowdEmotion’s has gained traction in recent years, and is often used for identifying people in photos. Facebook uses “DeepFace” to pin point who’s who in images so it can predict who you might want to tag. The State Department uses the tech to catalogue faces of people registering for visas and passports into searchable databases. Scientists will soon use their own version of facial recognition to help save whales by more quickly identifying them when they’re tangled up in fishing gear.

Now a few U.S. companies are starting to experiment with using facial recognition to track reactions of American TV viewers to commercials and TV shows. TVision, a company that measures “eyes-on-screen” is in about 600 households in the Boston area. Last weekend, the startup awarded the “most smiled at” ad of Super Bowl 50 to the Amazon Echo commercial. It’s the one in which Alec Baldwin parties with Dan Marino and Missy Elliott, while ordering his Echo voice assistant, Alexa, to do things around the house like turn on the lights and answer questions about Marino’s failed Super Bowl record.

Tim Cook tears into personal data-based advertising:

TV ratings giant Nielsen is also buying up facial recognition technology. Last year, it acquired Innerscope Research, a “neuromarketing” company that tracks emotions using skin sweat, eye movements, and other biometrics to find out exactly where audiences are looking on screen and how they feel. But so far Nielsen hasn’t used the new approaches in any of its industry-standard TV ratings.

There is a certain creep factor that goes along with monitoring what happens right in your living room. Samsung learned that the hard way last year when it warned users of its Smart TVs to watch what they say in conversation around their sets. That could be part of the reason why there are no prizes for the “most feared” or “happiest” show on television. At least not yet.

About the Author
By Hilary Brueck
See full bioRight Arrow Button Icon

Latest in Tech

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • World's Most Admired Companies
  • See All Rankings
  • Lists Calendar
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • Pinterest icon

Latest in Tech

Bridgit Mendler speaks on stage at Fortune Brainstorm Tech 2026 in Aspen, Colorado.
Startups & VentureBrainstorm Tech
The space economy’s next frontier is in ground infrastructure, Northwood Space CEO says
By Sebastian HerreraJune 10, 2026
4 hours ago
Digital sovereignty isn’t the same thing as digital isolation. Asia’s governments should be careful
Commentarydata sovereignty
Digital sovereignty isn’t the same thing as digital isolation. Asia’s governments should be careful
By Leonard LimJune 10, 2026
9 hours ago
Microsoft co-founder Bill Gates (C) arrives for a closed-door interview with the House Oversight Committee on Capitol Hill in Washington, DC, on June 10, 2026.
LawBill Gates
Gates testifies on Epstein: previous Fortune investigation reveals payments to his ex-girlfriend, $1M Microsoft deal
By Eva Roytburg, Joey Cappelletti, Hannah Schoenbaum and The Associated PressJune 10, 2026
10 hours ago
How the World Cup is a high-stakes stage for Big Tech’s AI push
NewslettersCIO Intelligence
How the World Cup is a high-stakes stage for Big Tech’s AI push
By John KellJune 10, 2026
11 hours ago
Anthropic accused of ‘secret sabotage’ as Claude Fable 5 silently limits capabilities for AI researchers and developers
AIAnthropic
Anthropic accused of ‘secret sabotage’ as Claude Fable 5 silently limits capabilities for AI researchers and developers
By Sharon GoldmanJune 10, 2026
12 hours ago
A 5-week course and a guaranteed job: Meta commits $115 million to solve the skilled-trades shortage stalling its AI build-out
Future of WorkMeta
A 5-week course and a guaranteed job: Meta commits $115 million to solve the skilled-trades shortage stalling its AI build-out
By Jacqueline MunisJune 10, 2026
12 hours ago

Most Popular

Pentagon accuses Alibaba, Baidu and BYD, three of China's biggest companies, of supporting the Chinese military
Asia
Pentagon accuses Alibaba, Baidu and BYD, three of China's biggest companies, of supporting the Chinese military
By Kate O'Keeffe and BloombergJune 8, 2026
2 days ago
Analysts expected oil to surge above $200 but China has quietly kept prices half of that—and can’t for much longer
Energy
Analysts expected oil to surge above $200 but China has quietly kept prices half of that—and can’t for much longer
By Sasha RogelbergJune 10, 2026
12 hours ago
Costco CEO Ron Vachris rose from forklift driver to the C-suite without a college degree: ‘Don’t chase a title’ is the career advice that got him there
Success
Costco CEO Ron Vachris rose from forklift driver to the C-suite without a college degree: ‘Don’t chase a title’ is the career advice that got him there
By Preston ForeJune 8, 2026
3 days ago
Marc Lore’s robots make 500 burrito bowls an hour. A human can make 45
Innovation
Marc Lore’s robots make 500 burrito bowls an hour. A human can make 45
By Amanda GerutJune 9, 2026
1 day ago
A ‘MAGA Warrior’ Texas ag chief is publicly blasting the USDA over a flesh-eating pest threatening America's beef supply
North America
A ‘MAGA Warrior’ Texas ag chief is publicly blasting the USDA over a flesh-eating pest threatening America's beef supply
By Marco Quiroz-GutierrezJune 10, 2026
20 hours ago
Current price of oil as of June 10, 2026
Personal Finance
Current price of oil as of June 10, 2026
By Joseph HostetlerJune 10, 2026
17 hours ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.