“I make $1.45 a week and I love it”

On Amazon Mechanical Turk, thousands of people are happily being paid pennies to do mind-numbing work. Is it a boon for the bored or a virtual sweatshop?

Topics: Unemployment, Amazon.com,

"I make $1.45 a week and I love it"

A picture of a woman’s pink shoe floats on my computer screen. It’s a flat, a street version of a ballet shoe. My job is to categorize the shoe based on a list of basic colors: Is it red, blue, pink, purple, white, green, yellow, multicolored? A description next to it reads “Pink Lemonade Leather.” This is not exactly a brain-busting task; I’m doing it while talking to a friend on the phone. With the mouse, I check a box marked “pink.” In the next split second, a picture of a navy blue shirt appears. I check “blue.” Assuming my answers jibe with those of at least two other people being paid to scrutinize the same pictures, I’ve just earned 4 cents.

With my computer and Internet connection, I have become part of a new global workforce, one of the thousands of anonymous human hands pulling the strings inside of a Web site called Amazon Mechanical Turk. By color-coding the clothing sold by the online retailer, which helps customers to search for, well, pink shoes, I can now call myself a Mechanical Turker. In this new virtual workplace, everything is on a need-to-know basis, including who is doing the work, what the point of the work is and, in some cases, the very identity of the company soliciting the work.

Launched in November 2005, Amazon Mechanical Turk is named after a legendary automaton from the 18th century, “the Turk,” which could play chess. The wooden man, adorned with a turban, appeared to be powered by the machinery of a clock. He even check-mated Benjamin Franklin, a devotee of the game. The Turk was a sensation: a machine that seemed to think. Coinciding with the birth of the Industrial Revolution, the Turk heightened anxieties that machines would replace humans in the workplace. Of course, it turned out to be a fabulous hoax. The ghost in the machine was, as skeptics had suspected, all too human. A chess expert was hidden in the Turk, making all the right moves.

The 21st century twist on the Turk, conceived by Amazon CEO Jeff Bezos, doesn’t try to hide the people inside the machine. On the contrary, it celebrates the fact that we have become part of the machine. For fees ranging from dollars to single pennies per task, workers, who cheekily call themselves “turkers,” do tasks that may be rote, like matching a color to a photograph, but they can confound a computer. Conceived to help Amazon improve its own sites, Mturk.com is now a marketplace where many companies have solicited workers to do everything from transcribing podcasts for 19 cents a minute to writing blog posts for 50 cents. Amazon takes a cut from every task performed.

Amazon claims its virtual workplace provides “artificial artificial intelligence” — a catchy way of saying human thought. “From a philosophical perspective, it’s really turning the traditional computing paradigm on its head,” says Adam Selipsky, vice president of product management and developer relations for Amazon Web Services. “Usually people get help from computers to do tasks. In this case, it is computers getting help from people to do tasks.” As Tim O’Reilly, a computer book publisher and tech industry figure, puts it on his blog, old dreams of artificial intelligence are “being replaced by this new model, in which we are creating more intelligent systems by using humans as components of the application.”

So who wants to be the human component of a computer application? A lot of people, it turns out. Since last November, thousands of workers from the U.S. and more than 100 other countries have performed tasks on Mturk.com. The most dedicated turkers have even formed their own online communities, such as Turker Nation.

The companies are certainly happy. The ones I contacted remarked how stunningly little it costs them to get work done through Amazon Mechanical Turk. Divvying up projects to hundreds of people not only gets the job done more quickly than contracting it out to temps or consultants — much less an actual employee — it gets it done much more cheaply. The tag line for the site could be: dirt-cheap artificial artificial intelligence. One tech company that uses Mturk.com to answer troubleshooting questions brags that it pays tens of dollars on Mechanical Turk for work that would typically cost thousands. And, hey, if companies don’t like the quality of the work they get from turkers, they simply don’t pay them.

As soon as it launched, the Mechanical Turk site sparked a hue and cry in the blogosphere. “Amazon, you cheap bastard. Don’t you at least have the decency to pay minimum wage?” demanded one poster on a tech site. Another commentator sneered that it peddled “jobs even illegal aliens won’t do.” There is something a little disturbing about a billionaire like Bezos dreaming up new ways to get ordinary folk to do work for him for pennies. Is a cut-rate pittance the logical result of tapping into a global workforce of people with a computer, an Internet connection and an Amazon account? And, really, who are all these people working for a measly 1 cent?

The real human ingenuity of Mechanical Turk shines in the novel ways that companies and workers use it to get tasks done efficiently. CastingWords is a transcription service built entirely on the work of Mechanical Turk transcribers and editors. With a little code, plus the turkers, it has succeeded in basically automating the process. The company charges its customers from 42 cents a minute for podcast transcription to 75 cents a minute for other audio. CastingWords pays Mechanical Turk workers as little as 19 cents a minute for transcription. If a transcription job is posted on Mechanical Turk for a couple of hours at the rate of 19 cents a minute, and no worker has taken on the project, the software simply assumes the price is too low and starts raising it.

After a transcription assignment is accepted by a worker, and completed, it goes back out on Mturk.com for quality assurance, where another worker is paid a few cents to verify that it’s a faithful transcript of the audio. Then, the transcript goes back on Mturk.com a third time for editing, and even a fourth time for a quality assurance check. “It’s been terribly useful for us,” says Nathan McFarland of Seattle, one of the co-founders of CastingWords. Transcription is the type of relatively steady task that keeps turkers with good ears who are fast typists coming back. “There are people who have been with us for months, and they’re not leaving,” says McFarland.

One of those workers is Kristy Milland, 27, a mother of one who runs an at-home day care in Toronto, as well as a Web site called RealityBBQ about the reality TV show “Big Brother.” “I have a lot of free time basically sitting at the computer while the kids play,” she says. Among the work she does is editing and quality assurance for CastingWords, but not transcription, because she has tendinitis. When Mturk.com first began, Milland would churn through 3-cent HITs. (That’s “human intelligence tasks,” Turker lingo for jobs.) Amazon was paying turkers to make sure that photos of businesses used on its A9 site, a local search engine, matched the actual businesses listed, a task a computer can’t do. In an eight-hour day, when she didn’t have the kids to watch, Milland could go through 1,000 photos, making a cool $30.

Lately, she’s found a way to goose her earnings by competing for bonuses. A number of service companies use Mechanical Turk to do a “human augmented search.” Say you’re in a sports bar and having an argument about whether Roger Clemens has ever thrown a no-hitter. You can end the debate once and for all with a call to one of the services, which instantly posts the question on Mechanical Turk. Turkers then surf the Web and generally earn 2 cents for each answer.

Back in the sports bar, when you get the answer — “Clemens has never pitched a no-hitter” — you can rate the answer as great, good, lame or junk. Answers deemed “lame” or “junk” are rejected and the worker is not paid. If you don’t rate the answer at all, the worker is automatically paid his or her 2 cents after seven days. Turkers who get the most “great” votes in a week get bonuses of as much as $75. In a good week, Milland can answer 100 research questions, making all of $2, but scoring one of those lucrative performance bonuses, she says, makes the search worthwhile.

The trivia pursuits are so competitive that they’re snatched up by turkers within a minute of being posted. So Milland has set up software to notify her whenever a new question shows up on Mechanical Turk, so she can be the first to grab it. Plus, she’s armed her Web browser with links to her top 100 reference sites so she can answer the questions as efficiently and accurately as possible. Turkers can choose to be paid in Amazon credit, making it easy to shop at the company store. Just the other day, Milland ordered $600 worth of DVDs and books for her family, as well as prizes for contests on her RealityBBQ. “It still doesn’t add up to a lot of money per hour, but if I’m sitting there watching TV anyway, it’s more than I’d make just sitting there,” she says.

Milland’s main beef with Mturk.com is that there’s no way to complain if a company rips her off by refusing to pay for good, accurate work. “Amazon basically says, tough, they can reject what they want,” she says. “There’s no recourse.” (Word of bad-apple companies, however, spreads fast on turker forums.) Milland would also like to see more work and more companies on Mturk.com. When the site first launched there was more to do, she says. These days it feels as if there are fewer opportunities and too many workers competing for them.

Of course, for all its rhetoric about artificial intelligence, Amazon did not launch Mechanical Turk for the good of science. For every task a worker completes for another company, the retailer collects a 10 percent fee from that company. For cheap HITs that pay just a penny, Amazon charges the company half a cent per HIT. Companies need not know the real name, much less the address or Social Security number, of turkers. Unless a worker earns more than $600 from a given company, the business has no obligation to issue the worker a tax form, or report the earnings to the Internal Revenue Service. Few workers cross that $600 threshold with any one company. Yet workers are required to report the money they earn on Mturk.com to the IRS as income — yes, even the $1.45 I made — to be taxed at the high rates of the self-employed. There’s no chance that a worker might land a full-time job with a company through Mechanical Turk, since it’s expressly forbidden in the site’s “participation agreement,” which requires workers to submit all work through the site, and not directly to the requester.

To a labor activist like Marcus Courtney of WashTech, a tech workers union, the whole arrangement represents a dystopian vision of a virtual sweatshop. “What Amazon is trying to do is create the virtual day laborer hiring hall on the global scale to bid down wage rates to the advantage of the employer,” he says. “Here you have a major global corporation, based in the United States, that’s showing the dark side of globalization. If this is Jeff Bezos’ vision of the future of work, I think that’s a pretty scary vision, and we should be paying attention to that.”

Rebecca Smith, a lawyer for the National Employment Law Project, seconds that. “The creativity of business in avoiding its responsibility to workers never ceases to astound,” she says dryly. “It’s day labor in the virtual world.” Smith sees Mechanical Turk as just another scheme by companies to classify workers as independent contractors to avoid paying them minimum wage and overtime, complying with non-discrimination laws, and being forced to carry unemployment insurance and workers compensation. “It’s an example of cyberspace overtaking a country’s labor laws,” she says. Needless to say, the turkers don’t see it that way.

Curtis Taylor, 50, a corporate trainer in Clarksville, Ind., who has earned more than $345 on Mturk.com, doesn’t even think of turking as work. To him, it’s a way to kill time. “I’m not in it to make money, I’m in it to goof off,” he says. Taylor travels a lot for business and finds himself sitting around in hotel rooms at night. He doesn’t like to watch TV much, and says that turking beats playing free online poker. To him, it’s “mad money,” which he blows buying gifts on Amazon, like Bill Bennett’s “America, the Last Best Hope,” for his son, a junior in high school. “If I ever stop being entertained, I’ll stop doing it,” he says. “I’ll just quit.”

Yet what’s a happy diversion for Taylor is serious business for the companies on Amazon Mechanical Turk. Efficient Frontier, a search engine marketing firm, has used Mturk.com to accomplish tens of thousands of tasks since early 2006. Efficient Frontier helps companies figure out which keywords will bring Web surfers to their sites. With Mturk.com, Efficient Frontier can afford to pay three different people to look at each potential keyword, and vote whether those words are relevant to a given site. It costs the company just 4.5 cents to test each keyword, paying 1.5 cents to Amazon, and 1 cent each to three turkers.

Sherwood Stranieri of SkyPromote, another search engine marketing firm in Boston, says he now has a virtual staff of 120 workers on Mturk.com. “It’s like a giant human computer,” he says. “It’s like having an infinite attention span.” Stranieri pays qualified turkers to surf a Web directory and figure out exactly where a specific site should be listed. He can get 300 of these tasks done in just five or six hours, even if he posts them on Mturk.com in the middle of the night. He pays 5 cents a task. “Pricing is very low right now because there are so many more workers than tasks right now,” he says. “People are fishing around for work to do.” Why do people do it if the pay is so low? It’s a question Stranieri wonders about himself. “I think it’s something of a hybrid between trying to make money on the side and a diversion, a substitute for doing a crossword puzzle. It’s sort of a mental exercise.”

Eric Cranston, 18, who recently graduated from high school, got into turking because at the time he didn’t have anything better to do. “When it came out,” he says, “I had just broken my foot, so I was just at home doing nothing on the computer. So, why not?” He’s used the money he’s made answering survey questions and transcribing podcasts to buy a game controller and a computer monitor. He recently transferred $200 to his bank account. “I don’t think anyone could actually make a living off of Mturk. There isn’t enough work,” Cranston says. He is one turker, however, who is plotting how to move up the food chain. Currently, Cranston and a friend are working to launch a Web-based business altering photographs, called Image Den, using, naturally, Mechanical Turkers to treat the images.

In its earliest days, someone posted a request on Amazon Mechanical Turk, offering to pay 2 cents for a drawing of a sheep facing left. Peter Cohen, director of Amazon Mechanical Turk, says the company was “puzzled by” the request. The requester was Aaron Koblin, a student in UCLA’s Design/Media Arts program, who was writing his master’s thesis about the site. He was intrigued by Amazon’s effort to “establish a framework for the utilization of people as computers,” as he wrote in his thesis. “My project was very tongue-in-cheek,” he tells me. “On the one hand, it’s using the system the way it’s meant to be used. On the other hand, it’s asking them to do this ridiculous thing.”

The grad student invited turkers to draw up to five sheep at the rate of 2 cents apiece. Over 40 days and 40 nights, the sheep flooded in at a rate of 11 per hour. By the end, 7,599 turkers had participated. He collected 12,000 sheep and promptly put 10,000 of them up for sale at the rate of $20 for 20 sheep at the Sheep Market. This caused some consternation among the people who had drawn them. “They’re selling our sheep!!!” wailed one poster on a turker message board. Another wrote: “Does anyone remember signing over the rights to the drawings?” In fact, they had. To participate in Amazon Mechanical Turk, workers, in the legalese of the site, “agree that the work product of any Services you perform is deemed a ‘work made for hire’ for the benefit of the Requester, and all ownership rights, including worldwide intellectual property rights, will vest with the Requester immediately upon your performance of the Service.”

Why sheep? Koblin relished all the associations that sheep have from the biblical followers of the good shepherd to George Orwell’s “Animal Farm.” The term “cottage industry” comes from peasants’ setting up shop at home, when it wasn’t planting or harvesting season, often spinning wool. “The cottage industry, which would employ entire families from their houses, has notable similarities to Mechanical Turk, such as employing people for spare time, working from home, and relative anonymity,” he wrote in his thesis.

Koblin wanted his project to capture the creativity expressed by turkers, while drawing attention to the insignificant role each of them played in the process. He certainly succeeded in capturing their creativity. Even after he stopped accepting sheep, and started selling them by the lot on the Internet, more people wrote to him wanting to contribute sheep for free. They just wanted to see their sheep join the herd. “Most of these people clearly weren’t in it for the money,” Koblin says. “They weren’t doing it so they could get 2 cents. It was more about participating in something larger.”

Maybe so. But maybe the ultimate message is: Congrats, fellow humans, we’re not obsolete! The machines, they still need us! Only at a very sheepish price.

More Related Stories

Featured Slide Shows

  • Share on Twitter
  • Share on Facebook
  • 1 of 11
  • Close
  • Fullscreen
  • Thumbnails

    Ten spectacular graphic novels from 2014

    Beautiful Darkness by Fabien Vehlmann & Kerascoët
    Kerascoët's lovely, delicate pen-and-watercolor art -- all intricate botanicals, big eyes and flowing hair -- gives this fairy story a deceptively pretty finish. You find out quickly, however, that these are the heartless and heedless fairies of folk legend, not the sentimental sprites beloved by the Victorians and Disney fans. A host of tiny hominid creatures must learn to survive in the forest after fleeing their former home -- a little girl who lies dead in the woods. The main character, Aurora, tries to organize the group into a community, but most of her cohort is too capricious, lazy and selfish to participate for long. There's no real moral to this story, which is refreshing in itself, beyond the perpetual lessons that life is hard and you have to be careful whom you trust. Never has ugly truth been given a prettier face.

    Ten spectacular graphic novels from 2014

    Climate Changed: A Personal Journey Through the Science by Philippe Squarzoni
    Squarzoni is a French cartoonist who makes nonfiction graphic novels about contemporary issues and politics. While finishing up a book about France under Jacques Chirac, he realized that when it came to environmental policy, he didn't know what he was talking about. "Climate Changed" is the result of his efforts to understand what has been happening to the planet, a striking combination of memoir and data that ruminates on a notoriously elusive, difficult and even imponderable subject. Panels of talking heads dispensing information (or Squarzoni discussing the issues with his partner) are juxtaposed with detailed and meticulous yet lyrical scenes from the author's childhood, the countryside where he takes a holiday and a visit to New York. He uses his own unreachable past as a way to grasp the imminent transformation of the Earth. The result is both enlightening and unexpectedly moving.

    Ten spectacular graphic novels from 2014

    Here by Richard McGuire
    A six-page version of this innovative work by a regular contributor to the New Yorker first appeared in RAW magazine 25 years ago. Each two-page spread depicts a single place, sometimes occupied by a corner of a room, over the course of 4 billion years. The oldest image is a blur of pink and purple gases; others depict hazmat-suited explorers from 300 years in the future. Inset images show the changing decor and inhabitants of the house throughout its existence: family photos, quarrels, kids in Halloween costumes, a woman reading a book, a cat walking across the floor. The cumulative effect is serene and ravishing, an intimation of the immensity of time and the wonder embodied in the humblest things.

    Ten spectacular graphic novels from 2014

    Kill My Mother by Jules Feiffer
    The legendary Pulitzer Prize-winning cartoonist delivers his debut graphic novel at 85, a deliriously over-the-top blend of classic movie noir and melodrama that roams from chiaroscuro Bay City to Hollywood to a USO gig in the Pacific theater of World War II. There's a burnt-out drunk of a private eye, but the story is soon commandeered by a multigenerational collection of ferocious women, including a mysterious chanteuse who never speaks, a radio comedy writer who makes a childhood friend the butt of a hit series and a ruthless dame intent on making her whiny coward of a husband into a star. There are disguises, musical numbers and plenty of gunfights, but the drawing is the main attraction. Nobody convey's bodies in motion more thrillingly than Feiffer, whether they're dancing, running or duking it out. The kid has promise.

    Ten spectacular graphic novels from 2014

    The Motherless Oven by Rob Davis
    This is a weird one, but in the nervy surreal way that word-playful novels like "A Clockwork Orange" or "Ulysses" are weird. The main character, a teenage schoolboy named Scarper Lee, lives in a world where it rains knives and people make their own parents, contraptions that can be anything from a tiny figurine stashable in a pocket to biomorphic boiler-like entities that seem to have escaped from Dr. Seuss' nightmares. Their homes are crammed with gadgets they call gods and instead of TV they watch a hulu-hoop-size wheel of repeating images that changes with the day of the week. They also know their own "death day," and Scarper's is coming up fast. Maybe that's why he runs off with the new girl at school, a real troublemaker, and the obscurely dysfunctional Castro, whose mother is a cageful of talking parakeets. A solid towline of teenage angst holds this manically inventive vision together, and proves that some graphic novels can rival the text-only kind at their own game.

    Ten spectacular graphic novels from 2014

    NOBROW 9: It's Oh So Quiet
    For each issue, the anthology magazine put out by this adventurous U.K.-based publisher of independent graphic design, illustration and comics gives 45 artists a four-color palette and a theme. In the ninth issue, the theme is silence, and the results are magnificent and full of surprises. The comics, each told in images only, range from atmospheric to trippy to jokey to melancholy to epic to creepy. But the two-page illustrations are even more powerful, even if it's not always easy to see how they pertain to the overall concept of silence. Well, except perhaps for the fact that so many of them left me utterly dumbstruck with visual delight.

    Ten spectacular graphic novels from 2014

    Over Easy by Mimi Pond
    When Pond was a broke art student in the 1970s, she took a job at a neighborhood breakfast spot in Oakland, a place with good food, splendid coffee and an endlessly entertaining crew of short-order cooks, waitresses, dishwashers and regular customers. This graphic memoir, influenced by the work of Pond's friend, Alison Bechdel, captures the funky ethos of the time, when hippies, punks and disco aficionados mingled in a Bay Area at the height of its eccentricity. The staff of the Imperial Cafe were forever swapping wisecracks and hopping in and out of each other's beds, which makes them more or less like every restaurant team in history. There's an intoxicating esprit de corps to a well-run everyday joint like the Imperial Cafe, and never has the delight in being part of it been more winningly portrayed.

    Ten spectacular graphic novels from 2014

    The Shadow Hero by Gene Luen Yang and Sonny Liew
    You don't have to be a superhero fan to be utterly charmed by Yang and Liew's revival of a little-known character created in the 1940s by the cartoonist Chu Hing. This version of the Green Turtle, however, is rich in characterization, comedy and luscious period detail from the Chinatown of "San Incendio" (a ringer for San Francisco). Hank, son of a mild-mannered grocer, would like to follow in his father's footsteps, but his restless mother (the book's best character and drawn with masterful nuance by Liew) has other ideas after her thrilling encounter with a superhero. Yang's story effortlessly folds pathos into humor without stooping to either slapstick or cheap "darkness." This is that rare tribute that far surpasses the thing it celebrates.

    Ten spectacular graphic novels from 2014

    Shoplifter by Michael Cho
    Corinna Park, former English major, works, unhappily, in a Toronto advertising agency. When the dissatisfaction of the past five years begins to oppress her, she lets off steam by pilfering magazines from a local convenience store. Cho's moody character study is as much about city life as it is about Corinna. He depicts her falling asleep in front of the TV in her condo, brooding on the subway, roaming the crowded streets after a budding romance goes awry. Like a great short story, this is a simple tale of a young woman figuring out how to get her life back, but if feels as if it contains so much of contemporary existence -- its comforts, its loneliness, its self-deceptions -- suspended in wintery amber.

    Ten spectacular graphic novels from 2014

    Through the Woods by Emily Carroll
    This collection of archetypal horror, fairy and ghost stories, all about young girls, comes lushly decked in Carroll's inky black, snowy white and blood-scarlet art. A young bride hears her predecessor's bones singing from under the floorboards, two friends make the mistake of pretending to summon the spirits of the dead, a family of orphaned siblings disappears one by one into the winter nights. Carroll's color-saturated images can be jagged, ornate and gruesome, but she also knows how to chill with absence, shadows and a single staring eye. Literary readers who cherish the work of Kelly Link or the late Angela Carter's collection, "The Bloody Chamber," will adore the violent beauty on these pages.

  • Recent Slide Shows



Comment Preview

Your name will appear as username ( settings | log out )

You may use these HTML tags and attributes: <a href=""> <b> <em> <strong> <i> <blockquote>