Weak and Feeble Search Engines

Reply Mon 26 Jul, 2004 01:41 pm
I find that all of the search engines I use seem only to see a tiny bit of the Web. I often later find pages that some search never told me about that would have satisfied my search criteria. I've tried engines that claim to delve into the "invisible" parts of the Web, like BrightPlanet, but they suck too. Search engines I use regularly include Google, Excite, Yahoo, Lycos, Blowsearch, Meta Eureka, WindSeek, Alexa, Mamma, KillerInfo, HotBot, etc. I know that some of these are only meta engines. All of these seem to have databases that reflect only a very small fraction of the Web. What do you have to do to get a more thorough search?

P.S.: Of course, many engines, notably Teoma, bring back additional hits that violate my search criteria, and I don't want that either.
  • Topic Stats
  • Top Replies
  • Link to this Topic
Type: Discussion • Score: 0 • Views: 993 • Replies: 8
No top replies

Craven de Kere
Reply Mon 26 Jul, 2004 02:01 pm
Re: Weak and Feeble Search Engines
Brandon9000 wrote:
What do you have to do to get a more thorough search?

Have you seen the A2K toolbar?

It may or may not help, it will have any good engines but the problem might be existence and not your knowledge of them.

There are only two engines with good indexes, Google and Yahoo (with includes Alltheweb, Altavista etc).

The next big engine is the Teoma/ Ask Jeeves index.

After this, there is a big drop.

Wisenut is one you did not mention, it's the looksmart engine.

Gigablast is a one-man project that does ok, it has a small index.

The others are mostly just templated syndicated databases, heck I'll throw a search engine up here on A2K when I find a free 5 minutes.
0 Replies
Reply Mon 26 Jul, 2004 02:11 pm
I've been meaning to take a look at the A2K tool bar. I have also tried the other engines you mentioned. I've also tried ProFusion, As Jeeves, etc., etc. I have enough experience to conclude that no engine I've ever seen is getting a very large fraction of the public Web. There may be one out there, but I haven't found it.
0 Replies
Craven de Kere
Reply Mon 26 Jul, 2004 02:18 pm
Hmm, how do you calculate the fraction of the web?

For example, Alexa's index is massive, and constitutes pages that people have visted (the Alexa toolbar calls the spiders).

What you are describing might not be related to index size, but rather algo and queries.

Do the pages you later find just not show up high in the SERPs (search engine results pages) or are they not indexed at all?

It could be, that you find others later due to a different ranking system/query and not because of a small index.

IF you give examples I can have a look.
0 Replies
Reply Mon 26 Jul, 2004 04:40 pm
I just often search for things and later find references which should have come up with my search terms, but which no engine showed me. Also, typically, if the best of the engines finds 3 references, most of the others find fewer or none.

I'll have to post an example the next time it happens.
0 Replies
Craven de Kere
Reply Mon 26 Jul, 2004 04:49 pm
I have a present for you Brandon:


While reading up on SEO news (I now have a full-time job with search entgine optimization and keeping up to date is part of my job) I ran across this just a few minutes after seeing your thread.
0 Replies
Reply Mon 26 Jul, 2004 09:51 pm
Thank you, Craven. I'll take a look!
0 Replies
Mr Stillwater
Reply Mon 26 Jul, 2004 10:15 pm
Those net protocol confabs must be a riot Craven....

"Your search engine is weak and without honor!"
0 Replies
Reply Mon 26 Jul, 2004 10:20 pm
I use Dogpile. (www.dogpile.com). It seems to find some pretty obscure stuff I am looking for.
0 Replies

Related Topics

So I just joined Facebook.... - Discussion by DrewDad
YouTube Is Doomed - Discussion by Shapeless
Internet disinformation overload - Discussion by rosborne979
Participatory Democracy Online - Discussion by wandeljw
OpenDNS and net neutrality - Question by Butrflynet
Internet Explorer 8? - Question by Pitter
  1. Forums
  2. » Weak and Feeble Search Engines
Copyright © 2022 MadLab, LLC :: Terms of Service :: Privacy Policy :: Page generated in 0.03 seconds on 01/20/2022 at 03:21:59