Hey, Mitt: Blogs don’t count!

The Romney campaign cites them as proof his tax plan works, but think tanks aren't much more reliable. What is?

Topics: 2012 Elections, Tax Policy Center, On the Economy, Jared Bernstein, Barack Obama, Mitt Romney, 2012 Presidential Debates,

Hey, Mitt: Blogs don't count! (Credit: AP/Charles Dharapak)
This originally appeared on Jared Bernstein's blog, On the Economy.  

Of the six studies that Gov. Romney cites to defend his mathematically-challenged tax plan, a few were blogs and were thus often dismissed by critics as being de facto inadequate evidence simply by dint of being blog posts.  As an active, evidence-based blogger, I can only say…quelle horreur!

Actually, I think it’s entirely fair to heavily discount blogs as evidence.  Obviously, quality varies widely and there are no gate keepers on the net, and nothing approaching rigorous peer review.  However, there’s room for nuance.

First, some blogs, like the ones at CBPP and EPI (not to leave anyone out, but those are places I’ve worked so I know how they operate), generally report shortened, reader-friendlier versions of their studies, so judging those blogs as evidence depends on your view of their studies.

Which gets to my larger point—I wouldn’t generally trust blogs as evidence but neither would I trust every think tank report.  The most reliable basis for trustworthy evidence in social science is peer review, a process by which experts of the established knowledge on the topic, along with rigorous application of the rules of statistical evidence, evaluate the claims in the study before it can be published.

This process too, of course, is far from fool proof.  There are statistical outliers, but more problematic, embedded prejudices in social science—assumptions and even “fads” that undermine the peer review process.  For years, economic journals printed studies supporting self-regulation by rational actors that gave succor to Greenspanian laissez faire regulatory practices which in turn helped spawn the Great Recession.

Now, slowly, those articles are being replaced by new takes on an older set of ideas once espoused by Kindleberger and Minsky about inherent instabilities in the economic system.

But back to blogs, think tanks, and what constitutes evidence.  The thing I’ve always found useful about the work of the think tanks I trust is that they tend to take a pretty-much “just the facts ma’am” approach in their reporting.  CBPP and EPI reports, for example—again, places I cite because I know first hand how they make the sausage—tend to be based on data series from established data sources with little manipulation.  They offer interpretation, but the facts and data processes are right out there and derived from trustworthy source material.

In terms of using blogs for evidence, you’ve got to know with whom you’re dealing.  I can most reliably speak for myself and much of what I do in this space is report evidence from sources I judge to be reliable in ways that are intended to go down more easily.  When I present my own statistical evidence, I’m trying to follow the standards noted above re EPI/CBPP—plotting/interpreting reliable data.

But blogs are by nature quick, impressionistic takes on issues.  They can point you in the direction of deeper dives, but they will very rarely, I think, provide adequate evidence for policy decisions.

Case in point: Romney’s tax plan.  It would be ludicrous to trust a blog or an oped that threw some rough numbers together over the Tax Policy Center’s results, as the latter are based on a well-established tax model built by non-partisan experts that has a long track record of generating reliable facts about tax policy.  Certainly the blogs can play a very useful function in raising questions about the deeper studies, and even send the authors of the study back to the model for tweaks suggested by the bloggers.

But it’s actually pretty shocking to me—though I know I should develop a thicker skin—that the Romney campaign is now lurching around, daily trotting out new “studies” and “solutions” to their math problem–“we’ll broaden the base (but can’t say how)”…”we’ll cap deductions at $17,000”…”whoops…that doesn’t work…we’ll cap them at $25,000.”

[See here for TPC evidence that these caps also fail to raise enough revenue to offset the $5 trillion, 10-year cost of the tax cuts.  Since most deductions and credits accrue to higher income households, the caps do, however, raise revenue in a progressive manner.]

The Romney team clearly threw out their tax plan—20% cuts across the board—without any of the requisite spade work to see if it actually made sense.  And now that real studies are challenging it, they’re veering from “just trust us” to setting the evidentiary bar down so low that anything with numbers on it can clear it.

Not surprising, given the beating the facts have taken in this election cycle, but not so good for democracy, not to mention the truth.

Continue Reading Close

Jared Bernstein joined the Center on Budget and Policy Priorities in May 2011 as a Senior Fellow. From 2009 to 2011, Bernstein was the Chief Economist and Economic Adviser to Vice President Joe Biden. Follow his work via Twitter at @econjared and @centeronbudget.

Next Article

Featured Slide Shows

What To Read Awards: Top 10 Books of 2012 slide show

close X
  • Share on Twitter
  • Share on Facebook
  • Thumbnails
  • Fullscreen
  • 1 of 10
  • 10. "The Guardians" by Sarah Manguso: "Though Sarah Manguso’s 'The Guardians' is specifically about losing a dear friend to suicide, she pries open her intelligent heart to describe our strange, sad modern lives. I think about the small resonating moments of Manguso’s narrative every day." -- M. Rebekah Otto, The Rumpus

  • 9. "Beautiful Ruins" by Jess Walter: "'Beautiful Ruins' leads my list because it's set on the coast of Italy in 1962 and Richard Burton makes an entirely convincing cameo appearance. What more could you want?" -- Maureen Corrigan, NPR's "Fresh Air"

  • 8. "Arcadia" by Lauren Groff: "'Arcadia' captures our painful nostalgia for an idyllic past we never really had." -- Ron Charles, Washington Post

  • 7. "Gone Girl" by Gillian Flynn: "When a young wife disappears on the morning of her fifth wedding anniversary, her husband becomes the automatic suspect in this compulsively readable thriller, which is as rich with sardonic humor and social satire as it is unexpected plot twists." -- Marjorie Kehe, Christian Science Monitor

  • 6. "How Should a Person Be" by Sheila Heti: "There was a reason this book was so talked about, and it’s because Heti has tapped into something great." -- Jason Diamond, Vol. 1 Brooklyn

  • 4. TIE "NW" by Zadie Smith and "Far From the Tree" by Andrew Solomon: "Zadie Smith’s 'NW' is going to enter the canon for the sheer audacity of the book’s project." -- Roxane Gay, New York Times "'Far From the Tree' by Andrew Solomon is, to my mind, a life-changing book, one that's capable of overturning long-standing ideas of identity, family and love." -- Laura Miller, Salon

  • 3. "Billy Lynn's Long Halftime Walk" by Ben Fountain: "'Billy Lynn's Long Halftime Walk' says a lot about where we are today," says Marjorie Kehe of the Christian Science Monitor. "Pretty much the whole point of that novel," adds Time's Lev Grossman.

  • 2. "Bring Up the Bodies" by Hilary Mantel: "Even more accomplished than the preceding novel in this sequence, 'Wolf Hall,' Mantel's new installment in the fictionalized life of Thomas Cromwell -- master secretary and chief fixer to Henry VIII -- is a high-wire act, a feat of novelistic derring-do." -- Laura Miller, Salon

  • 1. "Behind the Beautiful Forevers" by Katherine Boo: "Like the most remarkable literary nonfiction, it reads with the bite of a novel and opens up a corner of the world that most of us know absolutely nothing about. It stuck with me all year." -- Eric Banks, president of the National Book Critics Circle

  • Recent Slide Shows

  • Share on Twitter
  • Share on Facebook
  • Thumbnails
  • Fullscreen
  • 1 of 10

More Related Stories

Comments

0 Comments

Comment Preview

Your name will appear as username ( profile | log out )

You may use these HTML tags and attributes: <a href=""> <b> <em> <strong> <i> <blockquote>