SALON

Monday, Feb 4, 2013 10:10 PM UTC

Online advertising’s racism mess

Why does Google's ad network think people with names like Latanya and Rasheed have an arrest record?

By

Topics: online advertising, Racism, latanya sweeney, Privacy, Google, AdSense,

Online advertising's racism mess

Harvard University’s Latanya Sweeney discovered an odd thing after searching for her own name via Google last year. An advertisement from an outfit called Instant Checkmate appeared, featuring her name followed by the word “Arrested?”

For a subscription fee, Instant Checkmate searches public records for criminal records. Sweeney paid the fee, but found no evidence that she herself had been arrested.

A specialist in online privacy, Sweeney was intrigued and suspicious. So she created an experiment to test whether Google’s AdSense technology was delivering different advertisements depending on whether the name being searched for sounded black or white. Were searches for names like Latisha or Rasheed returning advertisements containing different language than searches for Greg and Meredith? (I first learned about Sweeney’s research from an article in Technology Review.)

Her results were conclusive: at one host of Google AdSense ads, she writes, “a black-identifying name was 25 percent more likely to get an ad suggestive of an arrest record.” According to Sweeney, “there is less than a 0.1 percent probability that these data can be explained by chance.”

In her paper, Sweeney doesn’t answer definitively the question of who exactly is to blame for the clear pattern of racism she uncovered. But the most disturbing implication of her research is the possibility that neither Instant Checkmate nor Google did anything wrong on purpose. Google’s AdSense algorithm may just be automatically reflecting society’s built-in racism.

Here’s how AdSense works, according to Sweeney.

Google understands that an advertiser may not know which ad copy will work best, so an advertiser may give multiple templates for the same search string and the “Google algorithm” learns over time which ad text gets the most clicks from viewers of the ad. It does this by assigning weights (or probabilities) based on the click history of each ad copy. At first all possible ad copies are weighted the same, they are all equally likely to produce a click. Over time, as people tend to click one version of ad text over others, the weights change, so the ad text getting the most clicks eventually displays more frequently. This approach aligns the financial interests of Google, as the ad deliverer, with the advertiser.

Imagine the following scenario: An employer is Googling prospective job applicants. Some of those applicants have black-identified names. Due to his or her personal racism, the employer happens to be more likely to click on the InstantCheckmate ads that suggest “Arrested?” next to the black-identified names. And over time, Google’s AdSense algorithm learns that “ads suggestive of an arrest record” work better when associated with black-identified names. Voilà.

As an example of how racism begets more racism, Sweeney’s research is fascinating and depressing. In a world mediated by Google, every single click counts. Via an unthinking algorithm, the collective action of racist individuals using a search engine ends up reinforcing and perpetuating racist stereotypes.

UPDATE: A Google spokesman provided the following statement:

“AdWords does not conduct any racial profiling. We also have an ‘anti’ and violence policy which states that we will not allow ads that advocate against an organisation, person or group of people. It is up to individual advertisers to decide which keywords they want to choose to trigger their ads.”

Andrew Leonard

Andrew Leonard is a staff writer at Salon. On Twitter, @koxinga21. More Andrew Leonard.

Next Article

You Might Also Like

More Related Stories

Featured Slide Shows

Gripping photos: The people of the Turkey protests (slideshow)

close X
  • Share on Twitter
  • Share on Facebook
  • Thumbnails
  • Fullscreen
  • 1 of 11
  • The protests take on a festive element as police forces move out of the park and square. Wearing a gas mask, this young man dances to traditional Turkish music in front of Taksim Square’s Ataturk Monument.

  • In Gezi Park since March 31st, this protester, originally caught off-guard by the Government’s teargas and water cannons, went out and bought a Russian army mask from WWII, preparing for what was to come.

  • This rambunctious boy seems to be enjoying the chaos. After taking this picture he threw a stone at the already destroyed building in the background.

  • Forming a line, the police face off directly with protesters in Taksim Square. After a while, they retreated and there was a general cheer – a back-and-forth dance that has been common since the beginning of this protest.

  • An elderly woman in Gezi Park reads the news. The tent community occupying the park was violently destroyed on June 16th.

  • Many different groups had set up booths to promote their cause in Taksim Square and Gezi Park. Standing in front of one, this man waves his flag while posing with conviction.

  • Many home-remedies are used to minimize the effects of tear gas. This woman has put a milky solution on her face, removing her mask after the tear gas dissipated. Before sunrise, the police came again for another round of teargasing.

  • People capitalize on the uprising -- selling flags, beer, gas masks, sky lanterns and spray paint to name just a few of the popular items.

  • On Monday morning, June 11, the police execute a strong offensive. Many plain-clothed police officers, like the ones seen here, clash with protesters in the side streets away from the main stand-off in Taksim.

  • The authorities seem to be most aggressive in the night, pushing protesters away from the square and park. After being teargassed this young woman catches her breath with other protesters on Siraselviler Street.

  • Recent Slide Shows

  • Share on Twitter
  • Share on Facebook
  • Thumbnails
  • Fullscreen
  • 1 of 11

Related Videos

More Related Stories

Comments

 54 Comments

Comment Preview

Your name will appear as username ( settings | log out )

You may use these HTML tags and attributes: <a href=""> <b> <em> <strong> <i> <blockquote>

follow salon

Most Read

Popular on Reddit

links from salon.com

From Around the Web

Presented by Scribol
listener_new_rect The Listener: "We Are All Completely Beside Ourselves": Growing up primate

Recommendations