SALON

Thursday, Nov 1, 2012 9:45 AM UTC

Polls giving partisans lots of room to argue

By

Topics: From the Wires,

WASHINGTON (AP) — Don’t like the latest poll numbers on the presidential race? Just wait. More are coming — probably before you can say “margin of sampling error.”

Regardless of what any given poll says, it’s likely that someone — a campaign, an interest group, a political party or a rival polling operation — will argue that the survey is invalid at the same time someone else argues that it’s significant.

Polls have become political tools and have taken on outsized importance as they’ve become easier and cheaper to conduct.

A part of campaigns grounded in science, polling has lost some of its standing as a neutral record of voters’ attitudes and opinions and, at times, has become just another talking point. TV pundits and election analysts hang on every one-point shift, to heck with the margin of error.

Another twist this year: A pollster’s usually difficult task of reaching a representative pool of likely voters has become far more difficult in the aftermath of Superstorm Sandy’s march through the East Coast with just days to go before the election.

130 POLLS IN 57 DAYS

As long as there’s been polling, campaigns have released polls favorable to their cause, and independent pollsters have tried to capture the state of the race minus the internal campaign baggage. But now, with an array of options to conduct polling on the cheap, polls are far more frequent, more visible and more often used as campaign tools. In the 57 days since Labor Day, The Huffington Post’s Pollster blog shows 130 national polls have been conducted on the presidential horserace.

Not all of them are created equal.

As the minimum cost of conducting a poll has fallen from something like the sticker price of a Lexus to the cost of a 1998 Honda Civic, the simple dividing line of partisan-or-not has been complicated by questions of basic methodology. But as in car shopping, you get what you pay for.

A poll using more rigorous methodology — in which live callers dial a random sample of landline telephones and cellphones over the course of several nights, making multiple attempts at different times to reach a respondent before giving up and attempting to choose a random respondent within each household — can cost well over $50,000. Automated polls — using recorded voice interviewers, only dialing landlines, taking whoever answers the phone and only on one night — can cost as little as $2,000.

Those more expensive polls cost so much more because they adhere to survey research rule No. 1: Every person should have a known, non-zero chance of being included in a survey’s sample. If you only dial landlines, the cellphone-only voters have zero chance of being included. Likewise, if you only dial on Wednesday night, anyone who isn’t home that night is automatically excluded from the sample and the pollster has no way of knowing who those people are.

Much of the proliferation of polling in the last few years has come from the cheaper end of the scale, with automated pollsters dominating popular poll aggregations. Polls conducted using automated methodology do not meet the standards for coverage of The Associated Press, nor do partisan polls.

MIND THE GAP

For the public, this has meant new polling almost daily, some of it conflicting. And as pundits and prognosticators seek to explain the differences between polls, more are focused on pollsters with a finger on the scale rather than on the random variation that pollsters expect.

This campaign season has produced a string of polling-related controversies over such issues as weighting surveys by party identification, sampling likely vs. registered voters, how pollsters measure race and ethnicity, and whether public pollsters were using their polls to change the narrative of a particular race.

As these controversies rage, the standard caveats about a poll’s margin of sampling error seem to have gone out the window. Polling analysts and aggregators put every 1- or 2-point shift under a microscope, even though almost no poll is accurate enough to detect changes that small with any certainty.

Whether valid or not, criticisms that suggest pollsters are fixing the data to get a desired result have done a number on polling’s reputation. By the end of the 2008 contest, almost 4 in 10 voters told Fox News pollsters they thought media pollsters were fixing their numbers for Obama, and the public’s take on polls became as partisan as any other part of the campaign.

At the end of recent presidential campaigns, the Pew Research Center has asked voters to give pollsters a letter grade for their performance. In 2008, 64 percent of Democrats gave pollsters an A or B for their performance in the campaign, while just 37 percent of Republicans felt the same, a 27-point gap. Four years earlier, the partisan gap was 11 points, and in 2000, a slim 7 points separated partisans.

READING THE FINAL POLLS

In the final days of the campaign, the polls will continue, with most major pollsters releasing their final estimate of the presidential horserace just before Election Day and prognosticators massaging them into their final projections. Typically, these last-chance estimates have converged as voters solidified their choices, but the massive storm that swept through the East Coast could complicate the picture for pollsters.

With millions of East Coast voters without power, voters in hard-hit states will be difficult to reach. And many “likely voters” could wind up not voting at all as they deal with the aftermath of the storm. Pollsters aiming to produce a final portrait of the race will have a hard time knowing for sure how big an impact the storm has had on the election forecast.

Before the storm, however, this year’s crop of polls had largely been in agreement that the race between Mitt Romney and Barack Obama was very close. Take the final round of public polling with a grain of salt and a pound of margin of error, and remember that polls are really just a snapshot in time.

___

EDITOR’S NOTE — Jennifer Agiesta oversees polling operations for The Associated Press.

___

Follow Jennifer Agiesta on Twitter: http://www.Twitter.com/JennAgiesta

More Jennifer Agiesta.

Next Article

Related Stories

More Related Stories

Featured Slide Shows

The week in 10 pics

close X
  • Share on Twitter
  • Share on Facebook
  • Thumbnails
  • Fullscreen
  • 1 of 11
  • Lisa Montgomery embraces her nephew Thursday after a tornado tore apart her home in Cleburne, Texas. The twister killed six people and destroyed entire swaths of the North Texas town.
    Credit: AP/LM Otero

  • Jack McMahon, the defense attorney for abortion doctor Kermit Gosnell, speaks outside the Criminal Justice Center in Philadelphia Tuesday. His client was convicted of killing three babies in his clinic, and will serve multiple life sentences.
    Credit: AP/Matt Rourke

  • A photo taken Monday captures Vice President Joe Biden's response to a Milwaukee second-grader's innovative proposal to end America's epidemic of gun violence. This guy!
    Credit: AP/Jenny Aicher

  • Sen. Rand Paul, R-Ky., flanked by a grouper-eyed Michele Bachmann, addresses the IRS' admission that it targeted Tea Party groups in advance of the 2012 election. In an op-ed for CNN Thursday, the Kentucky senator slammed the president for his faux outrage.
    Credit: AP/Molly Riley

  • Ousted IRS chief Steven Miller is sworn in on Capitol Hill Friday. Miller testified before the House Ways and Means Committee on the extra scrutiny the agency gave conservative groups applying for tax-exempt status.
    Credit: AP/J. Scott Applewhite

  • Attorney General Eric Holder pauses as he testifies on Capitol Hill before the House Judiciary Committee Wednesday. Holder is under fire, among other things, for the Justice Department's gathering of phone records at the Associated Press.
    Credit: AP/Carolyn Kaster

  • O.J. Simpson sits during an evidentiary hearing at Clark County District Court in Las Vegas, Nev., Thursday. Simpson, who is currently serving a nine-to-33-year sentence in state prison for armed robbery and kidnapping, is using a writ of habeas corpus to seek a new trial.
    Credit: AP/Las Vegas Review-Journal/Jeff Scheid

  • Major Tom to ground control: On Sunday astronaut Chris Hadfield recorded the first music video from space, a cover of David Bowie's "Space Oddity."
    Credit: AP/NASA/Chris Hadfield

  • When it rains it pours. President Barack Obama speaks during a news conference Thursday with Turkish Prime Minister Recep Tayyip Erdogan, inexplicably inspiring an #umbrellagate Twitter meme.
    Credit: AP/Jacquelyn Martin

  • A smoke plume rises high above a road block at the intersection of County A and Ross Road east of Solon Springs, Wis., Tuesday. No injuries were reported, but the the wildfire caused evacuations across northwestern Wisconsin.
    Credit: AP/The Duluth News-Tribune/Clint Austin

  • Recent Slide Shows

  • Share on Twitter
  • Share on Facebook
  • Thumbnails
  • Fullscreen
  • 1 of 11

Related Videos

Comments

 0 Comments

Comment Preview

Your name will appear as username

You may use these HTML tags and attributes: <a href=""> <b> <em> <strong> <i> <blockquote>

follow salon

Most Read

Popular on Reddit

links from salon.com

From Around the Web

Presented by Scribol
listener_new_rect The Listener: Chekhov's story mirrors Russia's own

Recommendations