Behind Facebook’s manipulation: Its Data Science team worked with little oversight

The experiment manipulating emotions is just a drop in the bucket

Topics: Facebook, Privacy, lab rats, psychology experiment, consent, Silicon Valley, Sheryl Sandberg, Mark Zuckerberg, user emotions, manipulated, ,

Behind Facebook's manipulation: Its Data Science team worked with little oversightThis July 2, 2013 file photo shows Facebook Chief Operating Officer Sheryl Sandberg speaking during Global Women Leadership Summit in Tokyo. (Credit: (AP Photo/Shizuo Kambayashi))

Over the weekend it was revealed that for a week back in 2012, Facebook manipulated the news feeds of nearly 700,000 users for a psychology experiment.

The Wall Street Journal delved into the researchers behind the experiment, Facebook’s Data Science team. Since 2007, according to the report, the Data Science team has run hundreds of experiments, with little oversight.

The recently exposed experiment showed that if there were more negative posts on a news feed, the person’s own posts were more likely to be negative. The same was true for an excess of positive stories on a news feed. Basically Facebook had the power to make users happier, or more disturbingly, elicit negative emotions.

The experiment’s ethics have been questioned, a researcher apologized for the “anxiety” caused by the experiment and even Facebook’s COO Sheryl Sandberg has spoken about the experiment, saying it was “poorly communicated.”

The public’s response: outrage. And understandably so. Users have put up with all manner of Facebook frustration, including petty changes in layout, dumb games, advertisements, alterations to privacy, use of data — but this experiment takes the cake.

This is just one of the many experiments run by the Data Science team at Facebook, and it only came under public scrutiny due to the fact that it was published in an academic journal. And it’s almost a good thing that it was, as this little known group at Facebook may have continued without user knowledge or oversight. The Wall Street Journal reports:

“Until recently, the Data Science group operated with few boundaries, according to a former member of the team and outside researchers. At a university, researchers likely would have been required to obtain consent from participants in such a study. But Facebook relied on users’ agreement to its Terms of Service, which at the time said data could be used to improve Facebook’s products. Those terms now say that user data may be used for research.

“‘There’s no review process, per se,’ said Andrew Ledvina, a Facebook data scientist from February 2012 to July 2013. ‘Anyone on that team could run a test,’ Mr. Ledvina said. ‘They’re always trying to alter peoples’ behavior.’

“He recalled a minor experiment in which he and a product manager ran a test without telling anyone else at the company. Tests were run so often, he said, that some data scientists worried that the same users, who were anonymous, might be used in more than one experiment, tainting the results.

“Facebook said that since the study on emotions, it has implemented stricter guidelines on Data Science team research. Since at least the beginning of this year, research beyond routine product testing is reviewed by a panel drawn from a group of 50 internal experts in fields such as privacy and data security. Facebook declined to name them.”

Other tests have included a published study looking into “how families communicate,” the Wall Street Journal reports. Studies looked at loneliness, how social behaviors move through social networks and a 2010 study on “political mobilization messages” and voting.

The company told the Wall Street Journal that it is considering additional changes to its practices.

Adam Kramer, who holds a Ph.D. in social psychology from the University of Oregon, said in a 2012 interview that Facebook was “the largest field study in the history of the world.”

Kramer is one of the researchers who ran the recently revealed emotions experiment — and has since responded to it. According to the Wall Street Journal, he said that in academia you must wait to be published and then have someone take notice, but at Facebook “I just message someone on the right team and my research has an impact within weeks, if not days.”

This must be quite the allure for the often doctorate-holding researchers at Facebook. But it is just another chilling reminder of how much power companies like Facebook have over users, and how much they abuse this data. The data being manipulated is that of real human beings — users, customers (if you consider our data a transaction with Facebook) of a product. And the lack of verbal consent (not just a Terms of Service agreement) or use of the Common Rule is disconcerting. The response from the parties involved drips with a complete lack of awareness of the invasive nature of the experiment.

Facebook may want to build a better product, reach more users, sell more ads, but that does not give license to treat users with a complete lack of respect.

This is apparently a practice not limited to Facebook, according to Kate Crawford, who is a researcher at Microsoft and a visiting professor at the Massachusetts Institute of Technology’s Center for Civic Media. She told the Wall Street Journal that companies “really do see users as a willing experimental test bed.”

h/t Wall Street Journal

Sarah Gray is an assistant editor at Salon, focusing on innovation. Follow @sarahhhgray or email

More Related Stories

Featured Slide Shows

  • Share on Twitter
  • Share on Facebook
  • 1 of 14
  • Close
  • Fullscreen
  • Thumbnails

    13 of "Girls'" most cringeworthy sex scenes

    Hannah and Adam, "Pilot"

    One of our first exposures to uncomfortable “Girls” sex comes early, in the pilot episode, when Hannah and Adam “get feisty” (a phrase Hannah hates) on the couch. The pair is about to go at it doggy-style when Adam nearly inserts his penis in “the wrong hole,” and after Hannah corrects him, she awkwardly explains her lack of desire to have anal sex in too many words. “Hey, let’s play the quiet game,” Adam says, thrusting. And so the romance begins.

    13 of "Girls'" most cringeworthy sex scenes

    Marnie and Elijah, "It's About Time"

    In an act of “betrayal” that messes up each of their relationships with Hannah, Marnie and Elijah open Season 2 with some more couch sex, which is almost unbearable to watch. Elijah, who is trying to explore the “hetero side” of his bisexuality, can’t maintain his erection, and the entire affair ends in very uncomfortable silence.

    13 of "Girls'" most cringeworthy sex scenes

    Marnie and Charlie, "Vagina Panic"

    Poor Charlie. While he and Marnie have their fair share of uncomfortable sex over the course of their relationship, one of the saddest moments (aside from Marnie breaking up with him during intercourse) is when Marnie encourages him to penetrate her from behind so she doesn’t have to look at him. “This feels so good,” Charlie says. “We have to go slow.” Poor sucker.

    13 of "Girls'" most cringeworthy sex scenes

    Shoshanna and camp friend Matt, "Hannah's Diary"

    We’d be remiss not to mention Shoshanna’s effort to lose her virginity to an old camp friend, who tells her how “weird” it is that he “loves to eat pussy” moments before she admits she’s never “done it” before. At least it paves the way for the uncomfortable sex we later get to watch her have with Ray?

    13 of "Girls'" most cringeworthy sex scenes

    Hannah and Adam, "Hard Being Easy"

    On the heels of trying (unsuccessfully) to determine the status of her early relationship with Adam, Hannah walks by her future boyfriend’s bedroom to find him masturbating alone, in one of the strangest scenes of the first season. As Adam jerks off and refuses to let Hannah participate beyond telling him how much she likes watching, we see some serious (and odd) character development ... which ends with Hannah taking a hundred-dollar bill from Adam’s wallet, for cab fare and pizza (as well as her services).

    13 of "Girls'" most cringeworthy sex scenes

    Marnie and Booth Jonathan, "Bad Friend"

    Oh, Booth Jonathan -- the little man who “knows how to do things.” After he turns Marnie on enough to make her masturbate in the bathroom at the gallery where she works, Booth finally seals the deal in a mortifying and nearly painful to watch sex scene that tells us pretty much everything we need to know about how much Marnie is willing to fake it.

    13 of "Girls'" most cringeworthy sex scenes

    Tad and Loreen, "The Return"

    The only sex scene in the series not to feature one of the main characters, Hannah’s parents’ showertime anniversary celebration is easily one of the most cringe-worthy moments of the show’s first season. Even Hannah’s mother, Loreen, observes how embarrassing the situation is, which ends with her husband, Tad, slipping out of the shower and falling naked and unconscious on the bathroom floor.

    13 of "Girls'" most cringeworthy sex scenes

    Hannah and the pharmacist, "The Return"

    Tad and Loreen aren’t the only ones to get some during Hannah’s first season trip home to Michigan. The show’s protagonist finds herself in bed with a former high school classmate, who doesn’t exactly enjoy it when Hannah puts one of her fingers near his anus. “I’m tight like a baby, right?” Hannah asks at one point. Time to press pause.

    13 of "Girls'" most cringeworthy sex scenes

    Hannah and Adam, "Role-Play"

    While it’s not quite a full-on, all-out sex scene, Hannah and Adam’s attempt at role play in Season 3 is certainly an intimate encounter to behold (or not). Hannah dons a blond wig and gets a little too into her role, giving a melodramatic performance that ends with a passerby punching Adam in the face. So there’s that.

    13 of "Girls'" most cringeworthy sex scenes

    Shoshanna and Ray, "Together"

    As Shoshanna and Ray near the end of their relationship, we can see their sexual chemistry getting worse and worse. It’s no more evident than when Ray is penetrating a clothed and visibly horrified Shoshanna from behind, who ends the encounter by asking if her partner will just “get out of me.”

    13 of "Girls'" most cringeworthy sex scenes

    Hannah and Frank, "Video Games"

    Hannah, Jessa’s 19-year-old stepbrother, a graveyard and too much chatting. Need we say more about how uncomfortable this sex is to watch?

    13 of "Girls'" most cringeworthy sex scenes

    Marnie and Desi, "Iowa"

    Who gets her butt motorboated? Is this a real thing? Aside from the questionable logistics and reality of Marnie and Desi’s analingus scene, there’s also the awkward moment when Marnie confuses her partner’s declaration of love for licking her butthole with love for her. Oh, Marnie.

    13 of "Girls'" most cringeworthy sex scenes

    Hannah and Adam, "Vagina Panic"

    There is too much in this scene to dissect: fantasies of an 11-year-old girl with a Cabbage Patch lunchbox, excessive references to that little girl as a “slut” and Adam ripping off a condom to ejaculate on Hannah’s chest. No wonder it ends with Hannah saying she almost came.

  • Recent Slide Shows


Loading Comments...