Dead Men Walking

dMw Chit Chat => The Beer Bar => Seriously though ... => Topic started by: delanvital on March 24, 2010, 08:57:05 AM

Title: Deep Web
Post by: delanvital on March 24, 2010, 08:57:05 AM
Hi all,

I have been looking into deep web (http://en.wikipedia.org/wiki/Deep_Web) recently. I do a LOT of searches at work, searching for business related info and regular Google+bing+yahoo is starting to come short. I do use a lot of (costly) databases, probably the biggest there are, but when they come short I get desperate.

I have tried about 20-30 deep web search engines now, and some are worth the effort, some are plain bull. What are your experiences? Which engines work, which are crap, what are the best directories and so forth...
Title: Deep Web
Post by: Penfold on March 24, 2010, 09:59:42 AM
Very interesting, I've not heard of it before.

I love the analogy of comapring it as  "dragging a net across the surface of the ocean; a great deal may be caught in the net, but there is a wealth of information that is deep and therefore missed".

Sorry I can't help with the quest but I'm certainly interested in the answers.

Nice one :)


Title: Deep Web
Post by: smilodon on March 24, 2010, 10:14:05 AM
Sadly I think it's a case of waiting for the main search engines to catch up with their Deep net versions. DeepPeep is one but alos look at

Kosmix (http://www.kosmix.com/) is supposed to do deep searches along side normal search style stuff, although I loath it's horrible MSN, Yahoo style layout.

Of course that leaves the darknet still untapped :) I use Freenet quite a bit and I cannot see how mainstream search engines will ever be able to catalogue that!
Title: Deep Web
Post by: delanvital on March 24, 2010, 10:40:41 AM
Quote from: smilodon;306799Sadly I think it's a case of waiting for the main search engines to catch up with their Deep net versions. DeepPeep is one but alos look at

Kosmix (http://www.kosmix.com/) is supposed to do deep searches along side normal search style stuff, although I loath it's horrible MSN, Yahoo style layout.

Of course that leaves the darknet still untapped :) I use Freenet quite a bit and I cannot see how mainstream search engines will ever be able to catalogue that!

Kosmix and DeepPeep are quite good. DeepPeep seems to be the most popular one in general, but not the best. I have now ended up with a collection of 30 or so engines, which all have their qualities in specific areas. Maybe one engine isn't possible at the moment...

Never used freenet, but found a client and will give it a go, cheers :)