Click to View

Yesterday, Google introduced Goggles, a visual search platform that lets folks perform Internet searches with pictures rather than words. The nascent technology , currently in Google Labs, is supposed to be ideal for things that aren't easy to describe verbally or through text input.

According to the Google Mobile Blog:

Goggles lets users search for objects using images rather than words. Simply take a picture with your phone's camera, and if we recognize the item, Goggles returns relevant search results. Right now Goggles identifies landmarks, works of art, and products (among other things), and in all cases its ability to "see further" is rooted in powerful computing, pervasive connectivity, and the cloud.

 

We first send the user's image to Google's datacenters

 

We then create signatures of objects in the image using computer vision algorithms

 

We then compare signatures against all other known items in our image recognition databases; and

 

We then figure out how many matches exist; and

 

We then return one or more search results, based on available meta data and ranking signals; and

 

We do all of this in just a few seconds

Google says Goggles works better with certain types of queries: books & DVDs, landmarks, logos, contact info, artwork, businesses, products, barcodes, or text. It is currently not as good when taking pictures of animals, plants, cars, furniture, or apparel.

For the best results when taking pictures, hold your phone in "left landscape" mode (see picture below) and press the on-screen shutter button with your right thumb. See here here for more Goggles, including tips on how to use the visual search technology.

Goggles is currently available for Android devices running Android 1.6 and above. But we don't see any reason why Google can't extend it to other smartphone platform eventually.

Check out the video below to how Goggles works.