Bing vs. Google: Where should you shop?

A heated battle is brewing over who provides the best results for consumers. Let's test it -- and buy some stuff!

Topics: Bing, Google, Microsoft, shopping, search engines, paid inclusion, danny sullivan,

Tut, tut; this isn’t what we call the Christmas spirit. Just in time for the full-throated final stretch roar of the holiday shopping season, Microsoft has launched a nasty attack on Google, accusing the search giant of betraying its principles by including paid advertisements for retail outlets in its Google Shopping search results.

In the beginning, Google preached, “Don’t Be Evil” — but that changed … when Google Shopping announced a new initiative. Simply put, all of their shopping results are now paid ads …

… We say that when you limit choices and rank them by payment, consumers get Scroogled. For an honest search result, try Bing.

Old-timers might find the spectacle of Microsoft accusing anyone else of unethical behavior designed to manipulate consumers and boost its own bottom line to be unseemly, if not outright laughably absurd and a tad humiliating. Once upon a time, Microsoft would have dealt with a pesky competitor by throttling its air supply and razing its headquarters. Alas, Microsoft no longer has the power to crush its enemies through the sheer leverage of its operating system monopoly control. Today, in terms of market share, Microsoft’s Bing search engine is the scrappy Chihuahua nipping at the ankles of Google’s Great Dane. Brute force won’t work, so Steve Ballmer and co. are getting wily. Thus, Microsoft’s “Scroogled” campaign, which simultaneously suggests that Google is screwing its users and treating them with the contempt we are accustomed to seeing displayed around this time of year by one Mr. Scrooge.

The truth is a little messier than Microsoft would have us believe.

No one has done more definitive reporting on the shopping search engine wars than Search Engine Land’s Danny Sullivan, here, here, here and here. Sullivan lays out a pretty clear case that Google has indeed fundamentally changed its position on what is known in the trade as “paid inclusion.” Introducing advertisements into search results used to be evil, evil, evil. Now, not so much. But Sullivan also notes that Microsoft’s own shopping results are hardly above suspicion. Microsoft partners with an operation called to provide specialized shopping search results, and companies do pay to be included prominently on

For its part, Google argues that anything that is properly labeled as “advertising” or “sponsored” does not fit into the category of “paid inclusion.” And certainly, there is no question that Google goes to great pains to provide transparency about what is and isn’t sponsored or otherwise paid for on its search results pages. That’s not in dispute. More controversially, Google claims that the big no-no of “paid inclusion” should only apply to paid-for results showing up in the “organic search results” that are generated in response to any ordinary query, and that are not labeled as advertising. By implication, then, Microsoft is the company that is being dishonest, because its stark declaration on every page of Bing Shopping that “Payment is NOT a factor used to rank search results in Bing” sidesteps the fact that many of the search results are in fact generated by paid inclusion in

I asked Microsoft about that seeming contradiction, and received a statement that said, in part: “While merchants can pay fees for inclusion on our third-party shopping sites and subsequently may appear in Bing Shopping through partnerships we have, we do not rank merchants higher based on who pays us, nor do we let merchants pay to have their product offers placed higher in Bing Shopping’s search results.”

I asked Google whether the company was betraying its foundational principles, and received the explanation that following the practice of proper disclosure prevented the company from descending into evil, along with a statement that said, in part: “We made the transition to Google Shopping to improve the shopping experience for our users. We believe that having a commercial relationship with merchants will encourage them to keep their product information fresh and up to date.”

I asked Danny Sullivan what he thought about Google’s self-serving self-defense and he said, “Bull. Google wants to unilaterally redefine an industry term from how it used it in the past, how the FTC has used it in the past, simply because it’s an embarrassing 180 for the company.”

Discerning shoppers can make up their own minds as to who is treating the holiday shopping experience with the appropriate authenticity and fidelity to traditional search engine values. But I suspect that most discerning shoppers won’t actually give a damn, because most shoppers have only one goal when searching for a product on the Internet that they want to buy, and that is to find a good deal. How well Bing Shopping and Google Shopping deliver on that promise is really the only thing that will determine who prospers.

So I went shopping!

I looked for four items. A rice maker, a French fry cutter, a USB Bluetooth adapter for my son, and a Cuisinart food processor. These items were not chosen arbitrarily — with the exception of the adapter, I was seeking replacements for kitchen appliances lost in a fire at my home this summer.

The first thing to understand when searching for a retail product on the Web, whether via Bing or Google, is that the whole notion of differentiating between what’s an advertisement and what is an “organic” search result is ridiculous. Advertisements utterly dominate the search results returned by both search engines. In almost every case, the first results you see at the top of the page are paid-for ads (marked as such on both Bing and Google). The right hand column of the page, on both Bing and Google, also includes a profusion of ads. Even the “organic” search results, which are now pushed way down toward the bottom half of the Web page (in some cases, you will only see a single “organic” result on the entire page), in the vast majority of cases simply direct you to websites put together by retail outlets who have successfully executed the task of figuring out how to get ranked highly according to the secret sauce algorithm employed by the respective search engine. A pure distillation of collective human wisdom about the best USB Bluetooth dongle out there, you are not going to find.

If you head to the Web to shop, you will see ads. Lots of them.

Clever searchers can find ways to get around this, sometimes. For example, a Google search for “best rice makers” delivers a high-ranked “organic” result that sends you to the extraordinarily useful Consumer Search site, which aggregates professional reviews and user reviews about products into a well-organized, informative package. Bing also rates ConsumerSearch highly, although, oddly, Bing inserted a group of links to news stories about Jerry Rice and Susan Rice in between the top-of-the-page advertisements and the organic results. C’mon, Bing, when I search for “best rice maker” I’m not looking for information about the best wide receiver of all time!

Such tactics are hit and miss. For example, a search for “best French fry cutter” doesn’t return any comparable distillation of French fry appliance expertise.

But never mind the organic results and the ads — the crux of the fight between Microsoft and Google is over the content of their dedicated Shopping search engines. When you search for a product on both Bing and Google, you will often, though not always, see somewhere on the page a group of images of the product in question. Click through to that page, and you are in dedicated Shopping land, where Microsoft declares that relevance is the only factor that determines what results you are looking at, and Google makes absolutely clear that “Google may be compensated by some of these providers.”

My general sense, after searching extensively for the four items above, is that Google does a better job of returning relevant results, even if they are compromised by the taint of cold, hard lucre. Google’s results are better organized, and often permit useful ways of further defining one’s search. For example, in the case of the Cuisinart food processor, Google allowed me to further search by “capacity” and specific features, such as “stainless steel” or “commercial.” Google also seemed to understand far better than Microsoft that when I search for a food processor or a rice maker, that is indeed what I am searching for, and not something quite different.

For example, when one searches for rice makers in Bing Shopping, the first five results include a Hello Kitty Rice Cake maker set, a cheapo Tupperware container for cooking rice in a microwave, and a fancy pants Zojirushi fuzzy logic rice cooker that decides for itself exactly how long your rice needs to be cooked. I was intrigued to see that the price range for the Zojirushi rice cooker ranged from $2.54 to $209.99.

Sure, $2.54 is a pretty good price for a state-of-the-art rice cooker (and one that gets good reviews from ConsumerSearch, by the way). But clicking through to the product page leads to a conundrum. Call me paranoid, but I am just not convinced that the $2.54 price tag is a real deal. And, in consequence, I become a little more skeptical of the other results returned by Bing.

Similarly, when one searches for a Cuisinart food processor on Bing Shopping, the very first result returned has a price range for a classic 14-cup processor stretching from $7.95 to $350. Click on the $7.95 offering (a “sponsored offer” from eBay, by the way) and you will discover that what is actually being advertised is a cleaning brush for a Cuisinart.

That’s not an honest search engine. That’s a dumb search engine. On Google Shopping, in contrast, a search for rice makers delivers rice makers and a search for Cuisinart food processors delivers Cuisinart food processors.

It seems obvious that by restricting membership in Google Shopping to retail outlets that pay for inclusion, Google ends up with a better data set that is easier to organize in useful ways. That’s something that I want when shopping for a product online.

However, I also want other things that aren’t reducible to questions of price or capacity or features. I want to know about quality. I want to know about durability. I want to know what people who take their rice very seriously think about the merits of various rice makers. And right now, both Bing and Google are doing a lousy job of incorporating that kind of information in their search results. In fact, by loading up their pages with so many advertisements that the “organic” results where one could dig for that kind of information are absolutely buried, both Bing and Google are actively doing a disservice to the customer.

Seriously, you’re better off just searching for your product on Amazon, ranking the results for popularity, and spending some time looking through the user reviews to find the best deal, as judged by the people whose opinion counts the most: the people who actually bought the product you are looking for. I have a lot of confidence in my next purchase, a Weston Restaurant Quality French Fry Cutter, because I trust the reviews a lot more than the algorithm.

Incidentally, you won’t find Amazon results in Google Shopping because the company refused to pay to be included. Which seems just a little bit weird — the biggest online retail outlet on the planet is not a part of Google Shopping? Hrm.

Andrew Leonard

Andrew Leonard is a staff writer at Salon. On Twitter, @koxinga21.

Featured Slide Shows

  • Share on Twitter
  • Share on Facebook
  • 1 of 11
  • Close
  • Fullscreen
  • Thumbnails

    Ten spectacular graphic novels from 2014

    Beautiful Darkness by Fabien Vehlmann & Kerascoët
    Kerascoët's lovely, delicate pen-and-watercolor art -- all intricate botanicals, big eyes and flowing hair -- gives this fairy story a deceptively pretty finish. You find out quickly, however, that these are the heartless and heedless fairies of folk legend, not the sentimental sprites beloved by the Victorians and Disney fans. A host of tiny hominid creatures must learn to survive in the forest after fleeing their former home -- a little girl who lies dead in the woods. The main character, Aurora, tries to organize the group into a community, but most of her cohort is too capricious, lazy and selfish to participate for long. There's no real moral to this story, which is refreshing in itself, beyond the perpetual lessons that life is hard and you have to be careful whom you trust. Never has ugly truth been given a prettier face.

    Ten spectacular graphic novels from 2014

    Climate Changed: A Personal Journey Through the Science by Philippe Squarzoni
    Squarzoni is a French cartoonist who makes nonfiction graphic novels about contemporary issues and politics. While finishing up a book about France under Jacques Chirac, he realized that when it came to environmental policy, he didn't know what he was talking about. "Climate Changed" is the result of his efforts to understand what has been happening to the planet, a striking combination of memoir and data that ruminates on a notoriously elusive, difficult and even imponderable subject. Panels of talking heads dispensing information (or Squarzoni discussing the issues with his partner) are juxtaposed with detailed and meticulous yet lyrical scenes from the author's childhood, the countryside where he takes a holiday and a visit to New York. He uses his own unreachable past as a way to grasp the imminent transformation of the Earth. The result is both enlightening and unexpectedly moving.

    Ten spectacular graphic novels from 2014

    Here by Richard McGuire
    A six-page version of this innovative work by a regular contributor to the New Yorker first appeared in RAW magazine 25 years ago. Each two-page spread depicts a single place, sometimes occupied by a corner of a room, over the course of 4 billion years. The oldest image is a blur of pink and purple gases; others depict hazmat-suited explorers from 300 years in the future. Inset images show the changing decor and inhabitants of the house throughout its existence: family photos, quarrels, kids in Halloween costumes, a woman reading a book, a cat walking across the floor. The cumulative effect is serene and ravishing, an intimation of the immensity of time and the wonder embodied in the humblest things.

    Ten spectacular graphic novels from 2014

    Kill My Mother by Jules Feiffer
    The legendary Pulitzer Prize-winning cartoonist delivers his debut graphic novel at 85, a deliriously over-the-top blend of classic movie noir and melodrama that roams from chiaroscuro Bay City to Hollywood to a USO gig in the Pacific theater of World War II. There's a burnt-out drunk of a private eye, but the story is soon commandeered by a multigenerational collection of ferocious women, including a mysterious chanteuse who never speaks, a radio comedy writer who makes a childhood friend the butt of a hit series and a ruthless dame intent on making her whiny coward of a husband into a star. There are disguises, musical numbers and plenty of gunfights, but the drawing is the main attraction. Nobody convey's bodies in motion more thrillingly than Feiffer, whether they're dancing, running or duking it out. The kid has promise.

    Ten spectacular graphic novels from 2014

    The Motherless Oven by Rob Davis
    This is a weird one, but in the nervy surreal way that word-playful novels like "A Clockwork Orange" or "Ulysses" are weird. The main character, a teenage schoolboy named Scarper Lee, lives in a world where it rains knives and people make their own parents, contraptions that can be anything from a tiny figurine stashable in a pocket to biomorphic boiler-like entities that seem to have escaped from Dr. Seuss' nightmares. Their homes are crammed with gadgets they call gods and instead of TV they watch a hulu-hoop-size wheel of repeating images that changes with the day of the week. They also know their own "death day," and Scarper's is coming up fast. Maybe that's why he runs off with the new girl at school, a real troublemaker, and the obscurely dysfunctional Castro, whose mother is a cageful of talking parakeets. A solid towline of teenage angst holds this manically inventive vision together, and proves that some graphic novels can rival the text-only kind at their own game.

    Ten spectacular graphic novels from 2014

    NOBROW 9: It's Oh So Quiet
    For each issue, the anthology magazine put out by this adventurous U.K.-based publisher of independent graphic design, illustration and comics gives 45 artists a four-color palette and a theme. In the ninth issue, the theme is silence, and the results are magnificent and full of surprises. The comics, each told in images only, range from atmospheric to trippy to jokey to melancholy to epic to creepy. But the two-page illustrations are even more powerful, even if it's not always easy to see how they pertain to the overall concept of silence. Well, except perhaps for the fact that so many of them left me utterly dumbstruck with visual delight.

    Ten spectacular graphic novels from 2014

    Over Easy by Mimi Pond
    When Pond was a broke art student in the 1970s, she took a job at a neighborhood breakfast spot in Oakland, a place with good food, splendid coffee and an endlessly entertaining crew of short-order cooks, waitresses, dishwashers and regular customers. This graphic memoir, influenced by the work of Pond's friend, Alison Bechdel, captures the funky ethos of the time, when hippies, punks and disco aficionados mingled in a Bay Area at the height of its eccentricity. The staff of the Imperial Cafe were forever swapping wisecracks and hopping in and out of each other's beds, which makes them more or less like every restaurant team in history. There's an intoxicating esprit de corps to a well-run everyday joint like the Imperial Cafe, and never has the delight in being part of it been more winningly portrayed.

    Ten spectacular graphic novels from 2014

    The Shadow Hero by Gene Luen Yang and Sonny Liew
    You don't have to be a superhero fan to be utterly charmed by Yang and Liew's revival of a little-known character created in the 1940s by the cartoonist Chu Hing. This version of the Green Turtle, however, is rich in characterization, comedy and luscious period detail from the Chinatown of "San Incendio" (a ringer for San Francisco). Hank, son of a mild-mannered grocer, would like to follow in his father's footsteps, but his restless mother (the book's best character and drawn with masterful nuance by Liew) has other ideas after her thrilling encounter with a superhero. Yang's story effortlessly folds pathos into humor without stooping to either slapstick or cheap "darkness." This is that rare tribute that far surpasses the thing it celebrates.

    Ten spectacular graphic novels from 2014

    Shoplifter by Michael Cho
    Corinna Park, former English major, works, unhappily, in a Toronto advertising agency. When the dissatisfaction of the past five years begins to oppress her, she lets off steam by pilfering magazines from a local convenience store. Cho's moody character study is as much about city life as it is about Corinna. He depicts her falling asleep in front of the TV in her condo, brooding on the subway, roaming the crowded streets after a budding romance goes awry. Like a great short story, this is a simple tale of a young woman figuring out how to get her life back, but if feels as if it contains so much of contemporary existence -- its comforts, its loneliness, its self-deceptions -- suspended in wintery amber.

    Ten spectacular graphic novels from 2014

    Through the Woods by Emily Carroll
    This collection of archetypal horror, fairy and ghost stories, all about young girls, comes lushly decked in Carroll's inky black, snowy white and blood-scarlet art. A young bride hears her predecessor's bones singing from under the floorboards, two friends make the mistake of pretending to summon the spirits of the dead, a family of orphaned siblings disappears one by one into the winter nights. Carroll's color-saturated images can be jagged, ornate and gruesome, but she also knows how to chill with absence, shadows and a single staring eye. Literary readers who cherish the work of Kelly Link or the late Angela Carter's collection, "The Bloody Chamber," will adore the violent beauty on these pages.

  • Recent Slide Shows



Comment Preview

Your name will appear as username ( settings | log out )

You may use these HTML tags and attributes: <a href=""> <b> <em> <strong> <i> <blockquote>