May 23, 2008

TinEye - Upload an Image and Find It on the Web

I've always thought that an image search engine should accept as an input images and list identical or similar images from the web. This is useful if you have an image, but you don't remember what it depicts or if you want to find a higher-quality version of an image.

TinEye tries to do that and the best part is that it mostly succeeds. The new image search engine, powered by Idée's technology and currently in private beta, has an index of 487 million images (Google's index is at least 12 times bigger) and manages to find identical versions of an image or alterations. According to the FAQ, "TinEye frequently returns image results with colour adjustments, added or removed text, crops, and slight rotations. TinEye can also detect images that are part of a collage or have been blended with another image."

And the FAQ doesn't lie: I uploaded a screenshot of Flickr's homepage that included a Flickr image in the top-left corner. TinEye returned 6 results: 5 of them were different versions of the featured image (including the original image hosted by Flickr) and another result showed Flickr's homepage with a different featured image.


Then I uploaded an image from my computer that shows fingers in a book scanned by Google and TinEye pointed to me to a TechCrunch article that included that image:


TinEye doesn't do a good job at ranking images, as it orders the images "by relevance i.e. how well the result image matches your query image". It can't figure out the most-likely original source of an image, so TinEye's algorithms could be combined with a traditional image search engine like Google's in order to determine the authority of each image. TinEye also doesn't recognizes faces or objects in an image, so it just looks for similar images.

How does it work then? "TinEye uses sophisticated pattern recognition algorithms to find your image on the web without the use of metadata or watermarks. TinEye instantly analyzes your query image to create a compact digital signature or 'fingerprint' for it. TinEye searches for your image on the web by comparing its fingerprint to the fingerprint of every single other image in the TinEye search index."

The search engine is in private beta, but you can request invite or watch this screencast:


{ Thanks, Life Tester. }

8 comments:

  1. I think this company become part of the Google. =)

    ReplyDelete
  2. Signed up for an invite. Been waiting for something like this, hope it works well.

    ReplyDelete
  3. Really, it works very well. Thanks master. Good share ;)

    ReplyDelete
  4. I like how they used Digg as praise.

    ReplyDelete
  5. I've been testing it out with some photos I had from my trip to Europe last summer. Mixed results. Surprisingly, it found nothing from any of my angles of the Eiffel tower, Big Ben, or St. Mark's Basilica. However, it did find matches for some other photos where most people taking them would have to have been standing in nearly the same place (and thus nearly have the same angle at the object).

    I assume it will get better as they add more images. Fun to use though--especially the toggle feature to compare your photos to the ones on the web.

    ReplyDelete
  6. wow...i ahve been waiting for somthing similar from so long...I wish google takes over this so that google huge database helps us find all the images..

    Grt work..

    ReplyDelete
  7. similar open-source technology (content-based image query-by-example) is available at http://server.imgseek.net/

    ReplyDelete
  8. @Ricardo:
    That's great. Any working demo? (the site included a demo for Flickr, but it didn't work)

    ReplyDelete