The polling firm complains operations like FiveThirtyEight could spoil polling for everyone
Did Gallup just blame Nate Silver for ruining the art and science of polling?
You don’t have to read too far between the lines of a statement from Gallup’s editor in chief, Frank Newport, published on Friday, to get that impression.
Newport first attempts the formidable task of defending Gallup’s polling accuracy during the 2012 campaign. Perhaps he was anticipating Silver’s Saturday column, which labeled Gallup the most inaccurate pollster of all the firms that measured voter sentiment this year. But Silver was hardly alone in wondering why Gallup regularly reported numbers much more favorable to Romney than anyone else in 2012. We deserve an explanation a little less lame than Newport’s: what’s the big fuss? Gallup wasn’t really off by that much.
But then it gets interesting:
But some of this will result from a variant of the venerable “law of the commons.” Individual farmers can each made a perfectly rational decision to graze their cows on the town commons. But all of these rational decisions together mean that the commons became overgrazed and, in the end, there is no grass left for any cow to graze. Many individual rational decisions can end up in a collective mess.
We have a reverse law of the commons with polls. It’s not easy nor cheap to conduct traditional random sample polls. It’s much easier, cheaper, and mostly less risky to focus on aggregating and analyzing others’ polls. Organizations that traditionally go to the expense and effort to conduct individual polls could, in theory, decide to put their efforts into aggregation and statistical analyses of other people’s polls in the next election cycle and cut out their own polling. If many organizations make this seemingly rational decision, we could quickly be in a situation in which there are fewer and fewer polls left to aggregate and put into statistical models. Many individual rational decisions could result in a loss for the collective interest of those interested in public opinion.
This will develop into a significant issue for the industry going forward.
It is impossible to read this as anything other than an attack on Nate Silver, who is by far the most prominent aggregator and analyzer of others’ polls currently operating today. And it simply reeks of sour grapes. During the campaign year, Silver consistently pointed out that Gallup’s results were oddly inconsistent with what other pollsters were finding. And he was right — Gallup got it wrong. It is not inappropriate to point that out. But Gallup presumes too much when it effectively threatens to take its surveys home and just stop playing.
OK, Nate Silver didn’t pick up the phone and call voters himself. And yes, it’s true, if all the polling organizations stop polling, Nate Silver will be out of a job. He might have to go back to crunching baseball stats. But he’s a smart guy, with an impressive track record. He’ll do fine. It seems foolish to blame him for crunching data that is publicly available for anyone to crunch. If he wasn’t good at what he does, he’d still be another anonymous poster hanging around the DailyKos forums. He’s been rewarded for getting things right.
Gallup faces a more unhappy future. If the company keeps getting the numbers wrong, the market will punish it. At that point, Gallup won’t be able to blame its sorry fate on anyone but its own incompetence.
More Related Stories
- London machete attack could be linked to terrorism
- Conservative group blames military sexual assault on "Don't Ask, Don't Tell" repeal
- Lois Lerner, IRS disaster
- Donald Rumsfeld worried that marriage equality will lead to polygamy
- San Francisco Giant Jeremy Affeldt apologizes for homophobic past
- 9-year-old slams Rahm over Chicago schools
- Experts: Fox News spying scandal a game-changer
- Stockholm riots rage for third day
- Wall Street firm's "Golden Pitchbook" is totally sexist, full of lies
- Must-see morning clip: Toronto's eccentric and allegedly crack-smoking mayor
- Federal court strikes down Arizona abortion ban
- Jodi Arias: I deserve a second chance
- Oklahoma residents return home to pick up the pieces
- Florida man with connection to Tsarnaev killed by FBI
- FBI identifies 5 Benghazi suspects
- Here come the tornado truthers. Already
- Peace Corps to allow gay couples to volunteer together
- Moore officials: Funds for "safe rooms" were held up by red tape
- Rand Paul: Congress should apologize to Apple, not the other way around
- Rescue crews race to find tornado survivors
- Looting in Oklahoma?
Featured Slide Shows
The week in 10 picsclose X
- 1 of 11
Lisa Montgomery embraces her nephew Thursday after a tornado tore apart her home in Cleburne, Texas. The twister killed six people and destroyed entire swaths of the North Texas town.
Credit: AP/LM Otero
Jack McMahon, the defense attorney for abortion doctor Kermit Gosnell, speaks outside the Criminal Justice Center in Philadelphia Tuesday. His client was convicted of killing three babies in his clinic, and will serve multiple life sentences.
Credit: AP/Matt Rourke
A photo taken Monday captures Vice President Joe Biden's response to a Milwaukee second-grader's innovative proposal to end America's epidemic of gun violence. This guy!
Credit: AP/Jenny Aicher
Sen. Rand Paul, R-Ky., flanked by a grouper-eyed Michele Bachmann, addresses the IRS' admission that it targeted Tea Party groups in advance of the 2012 election. In an op-ed for CNN Thursday, the Kentucky senator slammed the president for his faux outrage.
Credit: AP/Molly Riley
Ousted IRS chief Steven Miller is sworn in on Capitol Hill Friday. Miller testified before the House Ways and Means Committee on the extra scrutiny the agency gave conservative groups applying for tax-exempt status.
Credit: AP/J. Scott Applewhite
Attorney General Eric Holder pauses as he testifies on Capitol Hill before the House Judiciary Committee Wednesday. Holder is under fire, among other things, for the Justice Department's gathering of phone records at the Associated Press.
Credit: AP/Carolyn Kaster
O.J. Simpson sits during an evidentiary hearing at Clark County District Court in Las Vegas, Nev., Thursday. Simpson, who is currently serving a nine-to-33-year sentence in state prison for armed robbery and kidnapping, is using a writ of habeas corpus to seek a new trial.
Credit: AP/Las Vegas Review-Journal/Jeff Scheid
Major Tom to ground control: On Sunday astronaut Chris Hadfield recorded the first music video from space, a cover of David Bowie's "Space Oddity."
Credit: AP/NASA/Chris Hadfield
When it rains it pours. President Barack Obama speaks during a news conference Thursday with Turkish Prime Minister Recep Tayyip Erdogan, inexplicably inspiring an #umbrellagate Twitter meme.
Credit: AP/Jacquelyn Martin
A smoke plume rises high above a road block at the intersection of County A and Ross Road east of Solon Springs, Wis., Tuesday. No injuries were reported, but the the wildfire caused evacuations across northwestern Wisconsin.
Credit: AP/The Duluth News-Tribune/Clint Austin
Recent Slide Shows
- 1 of 11