• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia

Trendingnow

1

The Pentagon said Iran War costs $29 billion, but the real cost is closer to $200 billion—and counting

2

Now worth $200 million, Sarah Jessica Parker credits being ‘one of eight kids that struggled financially’ for her hunger, ambition, and work ethic

3

After forcing workers back to the office, Goldman Sachs and JPMorgan Chase are now letting their staff work remotely—but only for the World Cup

1

The Pentagon said Iran War costs $29 billion, but the real cost is closer to $200 billion—and counting

2

Now worth $200 million, Sarah Jessica Parker credits being ‘one of eight kids that struggled financially’ for her hunger, ambition, and work ethic

3

After forcing workers back to the office, Goldman Sachs and JPMorgan Chase are now letting their staff work remotely—but only for the World Cup
Commentary

Bernie Sanders Is Proof That Voters Shouldn’t Trust Polls

By
Euel Elliott
Euel Elliott
and
Bethany Cianciolo
Bethany Cianciolo
Down Arrow Button Icon
By
Euel Elliott
Euel Elliott
and
Bethany Cianciolo
Bethany Cianciolo
Down Arrow Button Icon
March 30, 2016, 11:25 AM ET
US-VOTE-DEMOCRATS-POLITICS-SANDERS
Democratic presidential candidate Bernie Sanders speaks during a rally at Safeco Field in Seattle on March 25, 2016. / AFP / Jason Redmond (Photo credit should read JASON REDMOND/AFP/Getty Images)Photograph by Jason Redmond — AFP via Getty Images
Add Fortune on Google for similar content.

If it is April in a presidential election year, then public opinion surveys are about as common as bluebonnets in Texas. Hardly a day goes by without seeing a new poll, whether it be a national-level poll looking at general support for the candidates or similar polls comparing Hillary Clinton and Bernie Sanders. Other polls look at state matchups among the contenders for their party’s nomination, and other polls, with the general election contest still seven months away, look at various head-to-head matchups. And while quite different, all polls have one thing in common: They can’t be trusted, and Sanders’ Michigan win is proof.

Polling has certainly come a long way from the very early days of survey research. Back in 1936, the soon-to-be defunct Literary Digest commissioned a poll that showed FDR losing to the Republican candidate by more than 20 points. Roosevelt went on to win the 1936 election by a margin of 61% to 39%, carrying every state but Maine and Vermont.

The Digest poll had committed the cardinal sin of not selecting a representative sample of the population. This particular survey had been done as a straw poll, using lists of telephone subscribers and others with higher income. Those who did have telephones were more well-to-do and educated, and voters in these demographic categories were substantially more likely to vote Republican. Thus, the poll sample was skewed badly in favor of Republican-Party identifiers, and seriously undercounted Democratic voters.

In the 1948 presidential race between Harry Truman and Thomas E. Dewey, the polls suggested a substantial victory for Dewey over Democratic incumbent Truman. The well-respected Gallup poll had Dewey winning by about six points. The problem wasn’t one of methodology. Rather, the pollsters simply assumed that Dewey’s lead, two weeks from the election, was insurmountable, and thus did not bother to continue polling up until Election Day. If they had, they might have been able to capture the impact of Truman’s “give ’em Hell” whistle-stop train campaign that mobilized Democratic voters in the closing days of the campaign (yes, even as late as 1948, candidates campaigned by train rather than by airplane).

And though pollsters today wouldn’t make that kind of mistake (society has a deeper appreciation for short-term campaign dynamics), they do face a similar challenge: to obtain a representative sample of the population (meaning, in theory, that every voter has an equal chance of being selected), and to obtain a sufficiently large sample so the margin of error is kept to a realistic minimum. So, while a sample of 500 voters yields, again assuming it is representative, a margin of error of just over four percentage points, a sample of 1,000 voters produces a margin of error of just over three percentage points.

Say there’s a survey before the election that has Clinton defeating Trump by 50% to 47%, and the margin of error is 3%. That means there is a 95% chance the true state of the race could have Clinton up by as much as nine points, or Trump could actually be ahead by about 50% to 47%. And, the laws of probability dictate that on average, the results will be outside the margin of error 5% of the time. One way to help determine if a poll is in the ballpark in terms of accuracy is to look at what pollsters call the “internals.” They provide demographic and party identification breakdowns, which can be extremely helpful in judging the veracity of a particular survey. For example, we know that on Election Day, the electorate will consist of about 52% women. If a survey’s sample is 60% female, then that’s a pretty good indicator that the poll is oversampling Democratic-leaning voters, since women tend to be more likely to vote for Democrats.

For election polls to be accurate, it is critical that the voters surveyed are those who will actually vote on Election Day. Reputable polls use various questions designed to determine if one is actually likely to show up to vote. The failure of the polls a few weeks ago to predict Sanders’ victory in the Michigan primary may well have been the result of polls’ inability to include many first-time voters who supported Sanders and who may have been excluded from the likely voter screens. Predicting primary results can be especially difficult, since turnout is generally, although not always, lower than in general elections, so determining who will vote can be more difficult than in a general election.

One major difficulty pollsters today face is obtaining cooperation from survey respondents. Participation levels can be as low as 10%, whereas in 30 or 40 years ago, well over half of those contacted would actually participate in the survey. This lack of cooperation perhaps reflects in part the increased disdain for politics and politicians, and the decline in confidence in America’s political institutions. Not only does this substantially increase the cost of conducting the survey, but it leaves the uncomfortable question as to whether there are systematic differences between those who cooperate and those who do not. To date, there is no empirical evidence of such differences (which, if true, would mean the sample of voters is not representative), but that has to be a concern lurking in pollsters’ minds. Moreover, given the costs of polling, automated voice-response systems are increasingly in vogue. But there’s concern that such automated systems may inadvertently have subtle, built-in bias that skew results in a particular way. Automated response systems are not legally able to contact cell phones, for instance, as cell phone polls can only be done by live interviewers.

As Americans are inundated by polls over the next several months through the general election, it’s important to not place too much reliance on any one survey. Voters should check the internals of the poll to see if the demographics appear plausible, look at multiple polls taken at roughly the same period of time, and check the margin of error. If one poll is an outlier, then the results should be substantially discounted. And, please, take pity on the poor pollsters, and help them out and participate!

Dr. Euel Elliott is a professor of public policy and political economy and the senior associate dean in the School of Economic, Political and Policy Sciences at the University of Texas at Dallas.

About the Authors
By Euel Elliott
See full bioRight Arrow Button Icon
By Bethany Cianciolo
See full bioRight Arrow Button Icon
Add Fortune on Google for similar content.

Latest in Commentary

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • World's Most Admired Companies
  • See All Rankings
  • Lists Calendar
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • Pinterest icon

Latest in Commentary

Asia’s defense boom is rewiring the global arms supply chain
Commentaryarms, weapons, and defense
Asia’s defense boom is rewiring the global arms supply chain
By Chris OberoiJune 24, 2026
9 hours ago
steve
Commentary250 Years of Innovation
Steve Case: America was built by entrepreneurs. Here’s how we keep that edge for the next 250 years
By Steve CaseJune 24, 2026
18 hours ago
t
CommentaryWhite House
Trump mistakes the bully pulpit for bullying leadership — history’s villains were never heroes
By Jeffrey Sonnenfeld and Steven TianJune 24, 2026
18 hours ago
mg
CommentaryHealth
The ‘tech neck’ time bomb: why 43 million young Americans could cripple U.S. health care within a generation
By Michael GerlingJune 24, 2026
19 hours ago
sb
Commentaryclimate change
The climate policy triangle: why leaders can no longer choose between growth, security and sustainability
By Sebastian BuckupJune 23, 2026
1 day ago
brett
CommentaryManagement
Middle managers aren’t going extinct—they’re evolving into something more powerful
By Brett HurtJune 23, 2026
2 days ago

Most Popular

The Pentagon said Iran War costs $29 billion, but the real cost is closer to $200 billion—and counting
Economy
The Pentagon said Iran War costs $29 billion, but the real cost is closer to $200 billion—and counting
By Jacqueline MunisJune 24, 2026
23 hours ago
Now worth $200 million, Sarah Jessica Parker credits being ‘one of eight kids that struggled financially’ for her hunger, ambition, and work ethic
Success
Now worth $200 million, Sarah Jessica Parker credits being ‘one of eight kids that struggled financially’ for her hunger, ambition, and work ethic
By Orianna Rosa RoyleJune 24, 2026
23 hours ago
After forcing workers back to the office, Goldman Sachs and JPMorgan Chase are now letting their staff work remotely—but only for the World Cup
Success
After forcing workers back to the office, Goldman Sachs and JPMorgan Chase are now letting their staff work remotely—but only for the World Cup
By Orianna Rosa RoyleJune 23, 2026
2 days ago
Amazon's record Prime Day masks a darker truth: Americans are spending more and getting less
Retail
Amazon's record Prime Day masks a darker truth: Americans are spending more and getting less
By Nick LichtenbergJune 24, 2026
15 hours ago
Ray Dalio just finished a 10-day trip to China. He says global leaders know America ‘doesn’t have what it takes to fight to maintain its empire’
Asia
Ray Dalio just finished a 10-day trip to China. He says global leaders know America ‘doesn’t have what it takes to fight to maintain its empire’
By Nick LichtenbergJune 24, 2026
17 hours ago
Current price of gold as of June 23, 2026
Personal Finance
Current price of gold as of June 23, 2026
By Danny BakstJune 23, 2026
2 days ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.