An unofficial blog that watches Google's attempts to move your operating system online since 2005. Not affiliated with Google.

Send your tips to gostips@gmail.com.

June 14, 2011

Google Adds Voice Search, Visual Search and Results Prerendering

Two of the most important Google mobile services: voice search and visual search will now be available from your computer.

Voice search, a feature that's built into Android, also works in Google Chrome and allows you to search using your voice. Chrome added support for the Speech Input API back in April and it's the only browser that implemented the API. Right now, Chrome's speech input feature is only available for English.

"We first offered speech recognition on mobile search, but you should have that power no matter where you are. You should never have to stop and ask yourself, 'Can I speak for this?' — it should be ubiquitous and intuitive. So we've added speech recognition into search on desktop for Chrome users. If you're using Chrome, you'll start to see a little microphone in every Google search box. Simply click the microphone, and you can speak your search," explains Google. The feature is gradually rolled out, so you may not see it yet.


Google Goggles is a full-fledged visual search engine that's trapped in a mobile application. But why do you have to buy a smartphone to use Google Goggles when you could simply upload an image to Google and find related pages and images on the Web? "Search by Image" does more than TinEye, the "reverse image search engine" that lets you find an image on the Web.

"Google uses computer vision techniques to match your image to other images in the Google Images index and additional image collections. From those matches, we try to generate an accurate 'best guess' text description of your image, as well as find other images that have the same content as your search image. Your search results page can show results for that text description as well as related images," mentions Google.

You can drag and drop an image to the search box, paste an image URL in the search box or click the camera icon and upload an image. Google generates a hybrid results page that shows both related images and Web search results for the equivalent text query.


Google also a developed two extensions for Chrome and Firefox that let you right-click on an image and use it as a query. "With these extensions, you can initiate a search on Google using pictures on the web. You can discover photos of places, learn more about art pieces, identify landmarks, and more."


While voice search and visual search are useful, the most impressive search feature launched by Google today is Instant Pages. The new feature only works in Chrome 13+ (available in Canary/Dev Channel and soon in beta), but it will radically improve your search experience. Chrome prerenders the top search result if it's likely that you will select it, so you no longer have to wait for the page to load. You might remember a feature called "prefetching" that was first supported by Firefox. Prerendering is a lot more powerful than prefetching.

According to a Chrome developer, "prefetch is Firefox style prefetching of resources specified (just populating the cache). In Chrome, with prerender, we don't just download the URL specified, but render the whole page including running all the JavaScript and downloading and rendering all the embedded resources."

For most users, Instant Pages will look like magic. They'll search for [nytimes] or [amazon], click the first result and be surprised to see that the page loads instantly. Google says that this feature saves 2-5 seconds on a typical search.


But Chrome's prerendering is not limited to Google searches. Any Web developer can use it by inserting a link element with a special value for the "rel" attribute. "Sometimes a site may be able to predict with reasonable accuracy which link the user is most likely to click on next -- for example, the 'next page' link in a multi-page news article. In those cases, it would be faster and better for the user if the browser could get a head start loading the next page so that when the user clicks the page is already well on its way to being loaded," suggests Google.

12 comments:

  1. So does Instant Pages prerender the top search result only? Taken another way, if I click on the second result, will I miss out on the prerender functionality?

    ReplyDelete
  2. Muy interesante la verdad que me gusta mucho y ahora es mucho mas rapido, gracias Google!!!

    ReplyDelete
  3. Visual search is definitely cool! I imagine if people would start looking for someone they know in the internet by just submitting a picture. Definitely useful in different areas

    ReplyDelete
  4. i am actually not that happy with the pre-render feature. after all, it "clicks" a link for me, that i haven't clicked. so i will show up in server logs from pages i actually have never seen.

    can't wait for the first court-case where this becomes an issue. "i did not visit the site" - "yes, you did, here is the server log" - "no i didn't" - "so how did your ip show up here" - "google instant pages must have opened it without my consent".....

    ReplyDelete
  5. @Cougar:

    It's probably only for navigational queries (which usually have a single dominant result). For example: [new york times] -> nytimes.com, [yahoo mail] -> mail.yahoo.com, [safari] -> apple.com/safari.

    ReplyDelete
  6. @Hans:

    You're right, this could be an important issue. Developers can use the Page Visibility API to tell if a page is loaded in the background. This is an experimental Chrome API which implements a W3C working draft. I'm sure that Google Analytics will use it to discard background page views.

    ReplyDelete
  7. You certainly don't want the browser pre-rendering when the link in question is in the body of an e-mail or any untrustworthy page. It could easily be a hijack that you would never click yourself.

    ReplyDelete
  8. @Alex. Ah, thanks for the explanation. I can see how that would be the case.

    ReplyDelete
  9. back to search by image...
    Feature works ok for me, but seems to rely heavily on color. I came up with a few good one's (which i really was unsure of the subject of the picture) and went through a *lot* of not-so-great results. Oddly though, no "reading" text in pictures. I wonder...

    ReplyDelete
  10. I tried the new image search, but all it did was take me to the normal search page.

    Anyone else encounter the same issues or have a solution.

    I am using the Chrome 12 the latest version.

    ReplyDelete
  11. www.macroglossa.com. ( alpha version ). This project seems a real visual search tool.

    ReplyDelete
  12. Try entering a descriptive word in the search box.
    Um... what is the difference between doing a text search?

    When does instant pages work?
    I tried searching for "pizza pizza" (the first result being www.pizzapizza.ca so it should be pretty easy to guess where I am going) and when I clicked the link it still used the internet and took about three seconds to load.
    is there an example of a search term that would work?

    ReplyDelete