Search Engine Report Card 2006

So everyone is coming out with lists, predictions and report cards, at the risk of being a "me too" I'll post my own opinion of the Big Four search engines.
First, I divide search engines into two broad categories: 1. Stand Alone index, this means that the search engine's own index is big enough and the algo is good enough that you can use it alone; 2. Meta-Search quality, the index and algo are not quite good enough to use as your only search engine but are good enough to use as part of a meta-search engine.

Major Search Engines -

Google: Stand Alone. While I don't thing the index is nearly as fresh or as relevant as it once was, Google is still the standard by which all other search engines are judged. What I do like about Google is that they still tend to favor what they think are content sites over commercial sites if possible.

Yahoo: Stand Alone. Yahoo is the only other search engine that really can be used alone for searching. Yahoo seems to favor commercial sites slightly in ranking, which is good if you are shopping or searching for products, but can be annoying when searching for information. Still it is a quality index.

MSN/Live: Meta-search quality. MSN has one of the freshest indexes and most aggressive spiders in the search engine world. I like that they still give significant weight to on-page factors in ranking, and they are not totally dependent on link popularity schemes. Unfortunately, this leaves them open to spam. I think their quality is slowly improving and hopefully MSN will find a happy balance between on-page and off-page ranking factors. MSN is great to have in a meta-search engine because of the freshness and aggressive spidering.

Ask: Meta-search quality. I think Ask is getting close to Stand Alone status, but their index is still smallish, not as fresh as I'd like and their spider is much too timid to deeply spider sites, especially dynamic sites, so it is missing lots of pages of content. Still they have not got there in 2006 but I have hopes they can spider better in the near future.

Minor Search Engines -

Exalead - Meta-search quality. This French based engine is impressive and has a nice interface. Personally I like it a lot. However, on commercially competitive searches it still ranks too many spammy sites highly. Good as a secondary engine in a meta-search.

Gigablast - Meta-search quality. I think Gigablast should be included as a secondary engine in any self respecting meta-search. Gigablast will dig up and rank some good sites the majors overlook which makes it valuable.

Wisenut - Meta-Search quality. Wisenut has good relevancy, but not very fresh index. Good to have in a meta-search because, like Gigablast, it digs up and ranks some good sites the others miss.

Note: I use Ask, MSN, Gigablast and Wisenut indirectly every day for searching as part of
Clusty meta-search, my default search engine. Those engines seem to do a good job for Clusty and other meta-search engines. When I need to dig deeper into a topic than a meta-search can provide, I use Yahoo and some directories like dmoz.org.

The scary part of this whole report card is that with the exception of relative newcomer Exalead, the report card is pretty much the same as it has been for the last few years. I think we might be stagnating badly in the search engine web index industry.

|