Algorithms rule the markets. They even read the papers
In today’s stock market, humans have largely been reduced to interested observers. The algorithms own the market now. Dow Jones and Bloomberg offer news services that are written specifically for the trading bots. These stories would be incomprehensible to a human, but make perfect sense to an algorithm. The news affects the markets, and just as Wall Street traders once skimmed Barron’s on their train ride in from Greenwich, now algorithms read the paper too. They just read it a lot faster.
When machines are at the controls, we can never be sure exactly what the market will do. The disappearance of $1 trillion in wealth on May 6, 2010, is a case in point. And the aftershocks continue. Six months later, Progress Energy, a utility in North Carolina, saw its shares shed 90 percent of their value in minutes for no apparent reason. Apple shares, which rode wild price swings on that May 6, inexplicably dropped 4 percent several months later, wiping out $16 billion of market cap before rebounding. Michael Kearns, a professor at the University of Pennsylvania who has written algorithms for traders and studied this new, machine-ruled market, says there’s no way to understand the implications of giving algorithms the full control that they now possess.
The competition between warring Wall Street algorithms has become so bizarre that there are days when 40 percent of the trades on all U.S. exchanges, from the Nasdaq to the NYSE, are made by just two midwestern companies that most people, even those who work in finance, have never heard of. One of them, Getco, is located in Chicago; the other, Tradebot, is in Kansas City. Both firms employ world-class hackers and engineers who are focused on clearing profits of often less than one cent per share. Getco and Tradebot deploy thousands of algorithms to scour the markets for the tiniest of opportunities. And there are thousands of other companies, some big, some small, that exist only to do the same thing—to make money on the market with bots. All in all, this means that algorithms are the stock market, as they now carry out 60 percent of all trades in the United States; European and Asian markets aren’t far behind. What once was determined by biting, swarming, and barking hordes of men is now decided by battling algorithms that are constantly testing each other, grappling for an edge, feigning their intentions, and learning as they trade.
There’s plenty of good that has arisen from algorithms’ role in our markets—the normal man’s ability to trade stock for $7 from the laptop screen in his kitchen being chief among them. As the market shifted from one where each order had to pass through pits of humans to one that’s facilitated by algorithms and exchanges hosted on computer servers, the costs of trading have plummeted. But we’ve blown by the utility of cheaper traders to a strange Star Wars–like battle that features fewer human inputs and more algorithmic autonomy. The speed at which something can go wrong is frightening. Knight Capital, one of the oldest and largest hands in the game, lost $440 million in 45 minutes on August 1 because of a software “glitch.”
Our stock markets have become such specialized electronic battlegrounds that some algorithms sit silently for months, waiting to ambush enemy algorithms that display design flaws, dated code, or a discernible pattern to their trading. Many of the algorithms plying our stock markets are built to mimic randomness. What’s random can’t be gamed, planned upon, or hijacked. For example, some of the most important algorithms on Wall Street trade stocks that belong to normal people—people who may own mutual fund shares in their 401(k) plans or IRAs. When a mutual fund company, be it Fidelity, Vanguard, or T. Rowe Price, makes a trade to add to a position or subtract from one, it’s inevitably a very large order. Trading a million shares of a stock, even a heavily traded one such as Apple or ExxonMobil, can move the market against the large seller or buyer. If other traders know that an order to buy a million shares is coming through the pipe, they will do whatever they can to get in front of it and buy up available shares. That way, they can repost their newly acquired shares for sale at a higher price knowing that they’ll get sucked into the mutual fund order.
When a mutual fund has to pay more for its shares, it costs the owners of that fund—normal people saving for retirement—money. To combat traders prowling for big orders to abuse, mutual funds and other institutional traders hired hackers to develop algorithms that randomly disguise their large trades by breaking them up into smaller ones. But Traders who were at first defeated by algorithms disguising big institutional orders soon developed complex scheming algorithms of their own that could sniff the market for large trades that had been disguised.
Mutual funds and institutions dealing in giant blocks of stock reacted by building better algorithms of disguise—bots that issued decoy trades and would easily shift strategies if they suspected detection. The hunters, again, responded in kind, leading us to the current state of the stock market wherein algorithms are the gladiators and normal people, just like in the days of the Colosseum, stand by and watch. It’s a fantastic game, although it has little to do with the base mission of the stock market: allowing growing companies an easy path to raising capital while giving the public a chance to invest in something that can build wealth in a meaningful way.
Wall Street leaders have acknowledged that a rogue series of algorithms could spark a string of colossal losses that their owners can’t cover. Because some high-speed trading algorithms are able to trade on margin with leverage, it’s conceivable that a series of bad trades, all conducted in seconds, could lead to a liquidity crisis, bankrupting a trader’s broker and the clients he trades for. Such incidents have nearly happened before. In late 2009, Chicago’s Infinium Capital Management, one of the more secretive and powerful trading houses in the United States, twice lost control of an algorithm that began selling S&P 500 futures as fast as it could, dropping the market.
This virtual world of warring algorithms is what has become of Wall Street and our money. It doesn’t stop there. The bot saga on Wall Street offers clues to what’s in store for much of our future world as we hand over more and more control of nearly everything to brilliant yet fallible algorithms.
Excerpted from “Automate This: How Algorithms Came to Rule Our World.” Published by Portfolio | Penguin. Copyright (c) Christopher Steiner, 2012.
More Related Stories
- How I ended up in a pyramid scheme
- My bipolar partner beat me
- Teenagers care more about online privacy than you think
- Radio host tweets rape joke, blames journalists for reporting on it
- El Salvador court delays ruling on abortion case while woman's life hangs in the balance
- Kicked out of the mall -- for an anti-cancer hat
- Why do men pretend to be women online?
- Pa. governor "can't find" any Latinos to work in his administration
- Conservative group blames military sexual assault on "Don't Ask, Don't Tell" repeal
- Is Pittsburgh the next Portland?
- Tornado survivor to Wolf Blitzer: Sorry, I'm an atheist. I don't have to thank the Lord
- Donald Rumsfeld worried that marriage equality will lead to polygamy
- San Francisco Giant Jeremy Affeldt apologizes for homophobic past
- Wall Street firm's "Golden Pitchbook" is totally sexist, full of lies
- Federal court strikes down Arizona abortion ban
- I'm not achieving my dreams!
- The most popular Tumblr porn
- Slave descendants seek equal rights from Cherokee Nation
- Snapchat is secretly storing your photos
- Peace Corps to allow gay couples to volunteer together
- Facebook's hate speech problem
Featured Slide Shows
The week in 10 picsclose X
- 1 of 11
Lisa Montgomery embraces her nephew Thursday after a tornado tore apart her home in Cleburne, Texas. The twister killed six people and destroyed entire swaths of the North Texas town.
Credit: AP/LM Otero
Jack McMahon, the defense attorney for abortion doctor Kermit Gosnell, speaks outside the Criminal Justice Center in Philadelphia Tuesday. His client was convicted of killing three babies in his clinic, and will serve multiple life sentences.
Credit: AP/Matt Rourke
A photo taken Monday captures Vice President Joe Biden's response to a Milwaukee second-grader's innovative proposal to end America's epidemic of gun violence. This guy!
Credit: AP/Jenny Aicher
Sen. Rand Paul, R-Ky., flanked by a grouper-eyed Michele Bachmann, addresses the IRS' admission that it targeted Tea Party groups in advance of the 2012 election. In an op-ed for CNN Thursday, the Kentucky senator slammed the president for his faux outrage.
Credit: AP/Molly Riley
Ousted IRS chief Steven Miller is sworn in on Capitol Hill Friday. Miller testified before the House Ways and Means Committee on the extra scrutiny the agency gave conservative groups applying for tax-exempt status.
Credit: AP/J. Scott Applewhite
Attorney General Eric Holder pauses as he testifies on Capitol Hill before the House Judiciary Committee Wednesday. Holder is under fire, among other things, for the Justice Department's gathering of phone records at the Associated Press.
Credit: AP/Carolyn Kaster
O.J. Simpson sits during an evidentiary hearing at Clark County District Court in Las Vegas, Nev., Thursday. Simpson, who is currently serving a nine-to-33-year sentence in state prison for armed robbery and kidnapping, is using a writ of habeas corpus to seek a new trial.
Credit: AP/Las Vegas Review-Journal/Jeff Scheid
Major Tom to ground control: On Sunday astronaut Chris Hadfield recorded the first music video from space, a cover of David Bowie's "Space Oddity."
Credit: AP/NASA/Chris Hadfield
When it rains it pours. President Barack Obama speaks during a news conference Thursday with Turkish Prime Minister Recep Tayyip Erdogan, inexplicably inspiring an #umbrellagate Twitter meme.
Credit: AP/Jacquelyn Martin
A smoke plume rises high above a road block at the intersection of County A and Ross Road east of Solon Springs, Wis., Tuesday. No injuries were reported, but the the wildfire caused evacuations across northwestern Wisconsin.
Credit: AP/The Duluth News-Tribune/Clint Austin
Recent Slide Shows
- 1 of 11