SALON

Tuesday, Nov 13, 2012 8:47 PM UTC

Gallup is very upset at Nate Silver

The polling firm complains operations like FiveThirtyEight could spoil polling for everyone

By

Topics: Gallup poll, Gallup, Polls, 2012 Elections, Nate Silver, Polling, FiveThirtyEight, ,

Gallup is very upset at Nate SilverNate Silver (Credit: AP/Nam Y. Huh)

Did Gallup just blame Nate Silver for ruining the art and science of polling?

You don’t have to read too far between the lines of a statement from Gallup’s editor in chief, Frank Newport, published on Friday, to get that impression.

Newport first attempts the formidable task of defending Gallup’s polling accuracy during the 2012 campaign. Perhaps he was anticipating Silver’s Saturday column, which labeled Gallup the most inaccurate pollster of all the firms that measured voter sentiment this year. But Silver was hardly alone in wondering why Gallup regularly reported numbers much more favorable to Romney than anyone else in 2012. We deserve an explanation a little less lame than Newport’s: what’s the big fuss? Gallup wasn’t really off by that much.

But then it gets interesting:

But some of this will result from a variant of the venerable “law of the commons.” Individual farmers can each made a perfectly rational decision to graze their cows on the town commons. But all of these rational decisions together mean that the commons became overgrazed and, in the end, there is no grass left for any cow to graze. Many individual rational decisions can end up in a collective mess.

We have a reverse law of the commons with polls. It’s not easy nor cheap to conduct traditional random sample polls. It’s much easier, cheaper, and mostly less risky to focus on aggregating and analyzing others’ polls. Organizations that traditionally go to the expense and effort to conduct individual polls could, in theory, decide to put their efforts into aggregation and statistical analyses of other people’s polls in the next election cycle and cut out their own polling. If many organizations make this seemingly rational decision, we could quickly be in a situation in which there are fewer and fewer polls left to aggregate and put into statistical models. Many individual rational decisions could result in a loss for the collective interest of those interested in public opinion.

This will develop into a significant issue for the industry going forward.

It is impossible to read this as anything other than an attack on Nate Silver, who is by far the most prominent aggregator and analyzer of others’ polls currently operating today. And it simply reeks of sour grapes. During the campaign year, Silver consistently pointed out that Gallup’s results were oddly inconsistent with what other pollsters were finding. And he was right — Gallup got it wrong. It is not inappropriate to point that out. But Gallup presumes too much when it effectively threatens to take its surveys home and just stop playing.

OK, Nate Silver didn’t pick up the phone and call voters himself. And yes, it’s true, if all the polling organizations stop polling, Nate Silver will be out of a job. He might have to go back to crunching baseball stats. But he’s a smart guy, with an impressive track record. He’ll do fine. It seems foolish to blame him for crunching data that is publicly available for anyone to crunch. If he wasn’t good at what he does, he’d still be another anonymous poster hanging around the DailyKos forums. He’s been rewarded for getting things right.

Gallup faces a more unhappy future. If the company keeps getting the numbers wrong, the market will punish it. At that point, Gallup won’t be able to blame its sorry fate on anyone but its own incompetence.

Continue Reading Close
Andrew Leonard

Andrew Leonard is a staff writer at Salon. On Twitter, @koxinga21. More Andrew Leonard.

Next Article

Related Stories

Featured Slide Shows

What To Read Awards: Top 10 Books of 2012 slide show

close X
  • Share on Twitter
  • Share on Facebook
  • Thumbnails
  • Fullscreen
  • 1 of 10
  • 10. "The Guardians" by Sarah Manguso: "Though Sarah Manguso’s 'The Guardians' is specifically about losing a dear friend to suicide, she pries open her intelligent heart to describe our strange, sad modern lives. I think about the small resonating moments of Manguso’s narrative every day." -- M. Rebekah Otto, The Rumpus

  • 9. "Beautiful Ruins" by Jess Walter: "'Beautiful Ruins' leads my list because it's set on the coast of Italy in 1962 and Richard Burton makes an entirely convincing cameo appearance. What more could you want?" -- Maureen Corrigan, NPR's "Fresh Air"

  • 8. "Arcadia" by Lauren Groff: "'Arcadia' captures our painful nostalgia for an idyllic past we never really had." -- Ron Charles, Washington Post

  • 7. "Gone Girl" by Gillian Flynn: "When a young wife disappears on the morning of her fifth wedding anniversary, her husband becomes the automatic suspect in this compulsively readable thriller, which is as rich with sardonic humor and social satire as it is unexpected plot twists." -- Marjorie Kehe, Christian Science Monitor

  • 6. "How Should a Person Be" by Sheila Heti: "There was a reason this book was so talked about, and it’s because Heti has tapped into something great." -- Jason Diamond, Vol. 1 Brooklyn

  • 4. TIE "NW" by Zadie Smith and "Far From the Tree" by Andrew Solomon: "Zadie Smith’s 'NW' is going to enter the canon for the sheer audacity of the book’s project." -- Roxane Gay, New York Times "'Far From the Tree' by Andrew Solomon is, to my mind, a life-changing book, one that's capable of overturning long-standing ideas of identity, family and love." -- Laura Miller, Salon

  • 3. "Billy Lynn's Long Halftime Walk" by Ben Fountain: "'Billy Lynn's Long Halftime Walk' says a lot about where we are today," says Marjorie Kehe of the Christian Science Monitor. "Pretty much the whole point of that novel," adds Time's Lev Grossman.

  • 2. "Bring Up the Bodies" by Hilary Mantel: "Even more accomplished than the preceding novel in this sequence, 'Wolf Hall,' Mantel's new installment in the fictionalized life of Thomas Cromwell -- master secretary and chief fixer to Henry VIII -- is a high-wire act, a feat of novelistic derring-do." -- Laura Miller, Salon

  • 1. "Behind the Beautiful Forevers" by Katherine Boo: "Like the most remarkable literary nonfiction, it reads with the bite of a novel and opens up a corner of the world that most of us know absolutely nothing about. It stuck with me all year." -- Eric Banks, president of the National Book Critics Circle

  • Recent Slide Shows

  • Share on Twitter
  • Share on Facebook
  • Thumbnails
  • Fullscreen
  • 1 of 10

Related Videos

More Related Stories

Comments

 52 Comments

Comment Preview

Your name will appear as username ( profile | log out )

You may use these HTML tags and attributes: <a href=""> <b> <em> <strong> <i> <blockquote>

follow salon

Most Read

From Around the Web

Recommendations