Types of Crawler Name.

Started by seoinheritx, 11-22-2012, 03:50:25

Previous topic - Next topic

seoinheritxTopic starter

Google boot
MSN boot
Slurp


abhirampathak3

Some crawler in my knowledge

Slurp
Bingbot
FAST Crawler
Googlebot


DavisJoseph

Slurp for Yahoo
Bingbot for Bing
Googlebot for Google
  •  

jayanta1

Web Crawlers are typical to identify and alongside it is also important for web crawler to identify so as needed site admin can be contacted. Some of the General Purpose Crawlers are...

1. Yahoo Slurp!
2. Googlebot.
3. World Wide Web Worm.
4. WebCrawler.
5. WebFountain.

Machostindia

Types of Crawler Name. Google boot. MSN boot.


satva89

Mainly Three Types Of Crawlers:

1. Googleboot for Google
2. MsNboot for MSN & Bing
3. Slurp for Yahoo
Safety Net [nofollow] | Sun Shade [nofollow] | Green House Net [nofollow]
  •  

raveenasen

Each Search Engine has its own crawler:

Google -- Googlebot
Yahoo -- Yahoo Slurp
MSN -- MSNbot
Ask -- Teoma
AltaVista -- Scooter
Excite -- Architect spider
Inktomi.com -- Slurp
Alexa -- ia_archiver
Look smart -- Mantra Agent
Lycus -- Lycos_Spider_ (T-Rex)
Cuil -- Twiceler.

Online reputation management

Sherinfriedler

Thanks for the information about the crawlers in search engine. Keep updating such information there are lots of others too.
And its Google Bot & MSN Bot not Boot..