
Smart mobs beat dumb CEOs
James Surowiecki's new book, "The Wisdom of Crowds," argues that diverse groups predict the future better than solo prima donnas.
By Farhad ManjooTopics: Business, Books, Entertainment News
On April 17, 1961, more than a thousand Cuban-exile paramilitary fighters landed at the Bay of Pigs, off the southern coast of Cuba, in an audacious effort to convince the local population to join a march toward Havana and overthrow Fidel Castro. Instead of finding pliant locals, though, the exiles, who’d been trained and armed by the American Central Intelligence Agency, were quickly and ignominiously defeated by Castro’s forces.
CIA investigators would later determine that the agency’s invasion plans had been seriously misguided — the CIA had underestimated Castro’s popularity and the strength of his military, it had failed to lay down any real plans for the post-invasion period, and it mistakenly assumed that the U.S. could plausibly deny any involvement in the mission, even though the press had been reporting on the exiles’ training for months prior to the invasion.
Why did the Kennedy administration launch this flawed mission? Because it “planned and carried out its strategy without ever really talking to anyone who was skeptical of the prospects of success,” writes James Surowiecki in “The Wisdom of Crowds,” his intriguing new book that examines the ways in which groups of people can become either smarter or dumber than their brightest members. Surowiecki, who writes the financial column for the New Yorker, holds up Kennedy’s foreign policy team as an example of one of the perils of group deliberation. Specifically, the Kennedy White House was the victim of what psychologist Irving Janis, who studied the decision-making process that led to the Bay of Pigs invasion, called “groupthink” — a phenomenon that causes small, homogeneous groups to unconsciously squelch dissent and ignore positions that run contrary to the group’s point of view, leading to often bizarre decisions.
Groupthink seems to run rampant in the halls of government these days, and Surowiecki does a service to the nation in untangling the causes of this menace. But he points out that groups can be felled by much more than groupthink. In Surowiecki’s view, people form precarious collections; if we’re not organized just right, our groups can make terrible decisions. The intelligence of a team, or of a much larger crowd, can be diminished if its members are not intellectually diverse, if its members do not make decisions independently of each other, and if the team is either too centralized or too decentralized. The network of open-source programmers who maintain Linux is an example of a group that gets things right; the team of NASA engineers that managed the space shuttle Columbia’s last mission is one that got things disastrously wrong.
Surowiecki’s is a big-idea book, reminiscent of his New Yorker colleague Malcolm Gladwell’s “The Tipping Point.” Although he spends much of the book pointing out all that can go wrong in a group or a crowd, Surowiecki’s big idea is that a well-designed group can be exceptionally intelligent, smarter even than its brightest member. Ask a crowd to guess the number of jelly beans in a jar and the average of their guesses will be almost exactly right. In the same way, people organized in markets, in betting pools, in corporations or even in governments can sometimes magically arrive at the correct solution to a tough problem.
In book form, Surowiecki’s writing sometimes meanders, and it lacks much of the elegance, and some of the delight, of his short pieces for the New Yorker. He also has a tendency to glut his arguments with apparently tangential examples, some of which raise more questions than they answer. Still, Surowiecki puts forward a compelling idea. In our world, we tend to think of intelligence as the province of individual “experts,” but Surowiecki convincingly argues that under the right circumstances, groups might be far better equipped to manage human affairs. In other words, this book should send corporate CEOs — the highest-paid experts in the land — running scared.
Surowiecki’s faith in the wisdom of crowds rests on what he calls “a mathematical truism.” If you ask a large group of diverse, independent people to predict or estimate something, when you average out their answers “the errors each of them makes … will cancel themselves out,” he writes. “Each person’s guess, you might say, has two components: information and error. Subtract the error and you’re left with the information.”
This simple fact can lead to remarkable results. Surowiecki points out, for instance, that within minutes of the explosion of the space shuttle Challenger, on Jan. 28, 1986, the stock market collectively determined which company to blame for the accident — and it got the right answer. While share prices of the four major contractors who’d worked on the shuttle declined after the accident, the stock of Morton Thiokol, the contractor that built the Challenger’s solid-fuel booster rockets, slipped the most. By the end of the trading day, the value of its shares had fallen by almost 12 percent, while the other three contractors had dropped by around 3 percent.
The shares of Morton Thiokol did not fall so precipitously because it had been publicly blamed for the accident, or because insiders at the firm were dumping stock; as Surowiecki notes, on the day of the explosion, there were no public comments indicating that Thiokol might bear some responsibility for what had happened, and even rumors concerning possible causes of the disaster did not implicate the company. Still, for some reason, the market chose Thiokol. And six months later, the commission investigating the disaster also blamed Thiokol. It was faulty O-ring seals on Thiokol’s booster rockets, the commission determined, that led to the Challenger’s demise.
How did the market correctly pick which firm to blame? Surowiecki concedes that it’s possible that someone in the market had inside knowledge of the defective O-rings. “But even if no one did, it’s plausible that once you aggregated all the bits of information about the explosion that all the traders in the market had in their heads that day, it added up to something close to the truth,” he writes.
Surowiecki is (understandably) captivated by this power of the market to aggregate different peoples’ ideas into a single “truth.” In business, as in much of the rest of life, predicting the future would be extremely valuable. Markets, Surowiecki says, can sometimes do an astonishingly good job of predicting which one of a number of different outcomes might come to pass. For some reason, though, many people, even businesspeople, shun markets; when we want to know what will happen in the future, we almost instinctively seek out experts rather than the crowd.
While corporations rely on the stock market to raise capital, Surowiecki points out that what’s done with that capital in most American businesses is often decided not by a market but instead by the whim of one “expert” — the CEO. And in the 1990s, these men were anointed as the superheroes of American business, pulling in obscenely large salaries and becoming cultural celebrities as a result of their supposed business prowess.
The problem was not just the hype, Surowiecki writes. “The problem was that people actually believed the hype, taking it for granted that putting the right individual at the top was the key to corporate success.” But this idea is deeply misguided. There is precious little evidence to indicate “that single individuals can consistently make superior forecasts or strategic decisions in the face of genuine uncertainty,” Surowiecki writes. Among academics, there is a debate over whether CEOs can make any dent on corporate performance, but even those who say that CEOs matter point out that their influence can be either positive or negative. For instance, two-thirds of all corporate mergers — almost always the brainchild of a lone CEO — fail. “This suggests that, at the very least, CEOs are not in general extraordinary decision makers,” Surowiecki writes.
Instead of having a CEO choose the company’s strategy, why not have employees participate in an internal market to set the course for a firm? Companies have been extremely reluctant to do this, Surowiecki says, but a few pilot projects in some firms indicate that the technique could be pretty handy. A test run by the economists Charles Plott and Kay-Yut Chen at Hewlett Packard gave a small group of employees the chance to buy and sell shares in a market meant to forecast long-term printer sales at the company. The market’s predictions outperformed the company’s forecasts 75 percent of the time. At Innocentive, a spinoff of the drug company Eli Lilly, employees used an experimental market to predict which three of six new drugs were likely to be approved by the FDA — and they picked the correct three, an extremely valuable trick in the high-stakes pharmaceutical world. Can a CEO who makes a hundred million dollars each year do that?
Surowiecki also has kind words for the Policy Analysis Market, the Defense Department project designed to use a market to predict threats in the Middle East. The project, which was roundly skewered as “offensive,” “harebrained” and “morally wrong” when it became public in the summer of 2003, was quickly abandoned by the government.
Surowiecki believes it was a bad idea to dump the DoD project. These days, the evidence abounds that the U.S. intelligence services have little insight into the Middle East. The problem is not just that we don’t know what’s going on in the region, but that what we think we know is sometimes way off. What the American public thought it knew about Saddam Hussein’s weapons capabilities, for instance, seems now to have not been the product of actual intelligence-gathering efforts but instead the result of spin, hype, bureaucratic infighting, a less-than-aggressive press corps, and baldfaced lies. A decision market might have mitigated such problems.
“Since traders in a market have no incentive other than making the right predictions — that is, there are no bureaucratic or political factors influencing their decisions,” Surowiecki writes, “they are more likely to offer honest evaluations instead of tailoring their opinions to fit the political climate or satisfy institutional demands.” In the case of Iraq, those who knew about Saddam’s actual weapons capabilities, or who were at the very least skeptical of the Bush administration’s threats, might have anonymously bet against the government’s claims in the PAM market. The public would then have had reason to be skeptical of the White House’s claims.
It’s true, of course, that markets can also get things wrong, and Surowiecki doesn’t ignore this. Indeed, one of the most engaging sections of his book is an examination of what caused the breakdown of the stock market during the technology bubble. Surowiecki points to a number of reasons the market performed so badly during the boom, but his main point is that at some point in the late 1990s, players in the market lost their independence from one another. Fed by a constant diet of stock-boosting news on CNBC, investors became single-minded, as each person thoughtlessly did what he believed everyone else was doing — buying tech stocks. The result was a seemingly endless upward spiral in stock prices, followed, suddenly, by a seemingly endless downward spiral.
Alas, there are few real solutions to avoiding bubbles in financial markets, Surowiecki explains. If you’re stuck in a market in which prices keep rising for no reason, what are you going to do — get out? If you did that, you’d lose the chance to make a killing. But if you stayed in the market, you’d risk being caught up in the crash. All you can do is hold your breath and hope for the best.
Yet despite the spasms of irrationality into which markets sometimes sink, we’d probably be better off casting our lot with groups than with individuals. Yes, stock markets sometimes do dumb things, but most of the time they’re pretty smart. Individuals, on the other hands, sometimes do smart things. But it’s what they do most of the time that should worry us.
Farhad Manjoo is a Salon staff writer and the author of True Enough: Learning to Live in a Post-Fact Society. More Farhad Manjoo.
You Might Also Like
More Related Stories
-
Country music has always been feminist, even if Taylor Swift isn't
-
John Horne Burns: The writer Hemingway and Vidal envied
-
John Mayer offers up "Paper Doll" as your new Prancercise jam
-
There are no unicorns in North Korea
-
Is Cindy McCain actually a gay "hero"?
-
On "The Bridge," normal is dangerous
-
Ai Weiwei on his incarceration: "They never looked away from me, 24 hours a day”
-
Is there a "liberal bias" in academia?
-
Dan Harmon apologizes for comparing "Community's" season 4 to rape
-
Former intern sues Atlantic Records
-
All about Kaidence, the reported name of Kanye West and Kim Kardashian's baby
-
Exclusive clip from "How to Make Money Selling Drugs"
-
Vice apologizes, pulls suicide-glorifying photo spread from Web
-
What "The Bling Ring" gets wrong about Valley girls
-
Must-see morning clip: "The Daily Show" on the return of Sarah Palin
-
Lil Wayne dances on top of American flag in new music video
-
Charles Saatchi cautioned over assault on wife
-
From "Bling Ring" to Oprah, "The Secret" lives on
-
A head trip to a haunted recording studio
-
Vice re-creates female authors' suicides for maximum trolling
-
Kanye West's sex problem
Featured Slide Shows
Gripping photos: The people of the Turkey protests (slideshow)
close X- Share on Twitter
- Share on Facebook
- Thumbnails
- Fullscreen
- 1 of 11
- Previous
- Next
-
The protests take on a festive element as police forces move out of the park and square. Wearing a gas mask, this young man dances to traditional Turkish music in front of Taksim Square’s Ataturk Monument.
-
In Gezi Park since March 31st, this protester, originally caught off-guard by the Government’s teargas and water cannons, went out and bought a Russian army mask from WWII, preparing for what was to come.
-
This rambunctious boy seems to be enjoying the chaos. After taking this picture he threw a stone at the already destroyed building in the background.
-
Forming a line, the police face off directly with protesters in Taksim Square. After a while, they retreated and there was a general cheer – a back-and-forth dance that has been common since the beginning of this protest.
-
An elderly woman in Gezi Park reads the news. The tent community occupying the park was violently destroyed on June 16th.
-
Many different groups had set up booths to promote their cause in Taksim Square and Gezi Park. Standing in front of one, this man waves his flag while posing with conviction.
-
Many home-remedies are used to minimize the effects of tear gas. This woman has put a milky solution on her face, removing her mask after the tear gas dissipated. Before sunrise, the police came again for another round of teargasing.
-
People capitalize on the uprising -- selling flags, beer, gas masks, sky lanterns and spray paint to name just a few of the popular items.
-
On Monday morning, June 11, the police execute a strong offensive. Many plain-clothed police officers, like the ones seen here, clash with protesters in the side streets away from the main stand-off in Taksim.
-
The authorities seem to be most aggressive in the night, pushing protesters away from the square and park. After being teargassed this young woman catches her breath with other protesters on Siraselviler Street.
-
Recent Slide Shows
-
Gripping photos: The people of the Turkey protests (slideshow)
-
The week in 10 pics
-
Photos: Turmoil and tear gas in Instanbul's Gezi Park - Slideshow
-
10 summer food festivals worth the pit stop
-
- Share on Twitter
- Share on Facebook
- Thumbnails
- Fullscreen
- 1 of 11
- Previous
- Next
-
The week in 10 pics
-
10 summer food festivals worth the pit stop
-
The week in 10 pics
-
The week in 10 pics
-
9 amazing drive-in movie theaters still standing
-
The week in 10 pics
-
The week in 10 pics
-
The week in 10 pics
-
The week in 10 pics
-
The week in 10 pics
-
The week in 10 pics
-
Netflix's April Fools' Day categories
-
The week in 10 pics
-
The week in 10 pics
-
The week in 10 pics
Related Videos
More Related Stories
-
Country music has always been feminist, even if Taylor Swift isn't
-
John Horne Burns: The writer Hemingway and Vidal envied
-
John Mayer offers up "Paper Doll" as your new Prancercise jam
-
There are no unicorns in North Korea
-
Is Cindy McCain actually a gay "hero"?
-
On "The Bridge," normal is dangerous
-
Ai Weiwei on his incarceration: "They never looked away from me, 24 hours a day”
-
Is there a "liberal bias" in academia?
-
Dan Harmon apologizes for comparing "Community's" season 4 to rape
-
Former intern sues Atlantic Records
-
All about Kaidence, the reported name of Kanye West and Kim Kardashian's baby
-
Exclusive clip from "How to Make Money Selling Drugs"
-
Vice apologizes, pulls suicide-glorifying photo spread from Web
-
What "The Bling Ring" gets wrong about Valley girls
-
Must-see morning clip: "The Daily Show" on the return of Sarah Palin
-
Lil Wayne dances on top of American flag in new music video
-
Charles Saatchi cautioned over assault on wife
-
From "Bling Ring" to Oprah, "The Secret" lives on
-
A head trip to a haunted recording studio
-
Vice re-creates female authors' suicides for maximum trolling
-
Kanye West's sex problem
Most Read
-
Why Sarah Palin actually matters again Joan Walsh
-
Lynda Obst: Hollywood's completely broken Lynda Obst
-
GOP plan to appeal to millennials: "Make abortion funny" Alex Seitz-Wald
-
To my daughter on Father's Day: Sorry I used to be a sexist Mo Elleithee
-
Why didn't anyone help? Mary Elizabeth Williams
-
The best of Tumblr porn Tracy Clark-Flory
-
Study: Reading novels makes us better thinkers Tom Jacobs, Pacific Standard
-
Rahm Emanuel is losing control of his city Mark Guarino
-
Jon Stewart who?: John Oliver's "Daily Show" is almost too good Willa Paskin
-
The most popular Tumblr porn Tracy Clark-Flory

Popular on Reddit
links from salon.com

2792 points2793 points2794 points | 343 comments

188 points189 points190 points | 5 comments



Comments
0 Comments