Search Engines > Google Search Optimization

Google Crawl rate

(1/5) > >>

tmcconnell:
What does everyone with dynamically updated websites set their crawl rate to? I don't want to waste too much bandwidth on googlebot but want recent caches in google.

moritzbokk:
it's a myth that you can determine when google's bots should come to crawl your site. It doesn't work
I mean think about it, people would say the bots they should come every 30 minutes

cisritu:

--- Quote from: tmcconnell on 05-15-2012, 16:51:48 ---What does everyone with dynamically updated websites set their crawl rate to? I don't want to waste too much bandwidth on googlebot but want recent caches in google.

--- End quote ---

I think we can not escape to an easy alternative or any things such as called  tricks.  People do use trick but using tricks is a risky task!
If you want your site to crawled faster you have compromise with the bandwidth.

Allenbrayan:
You need to update your content often and regularly (and ping Google once you do). Try to add new unique content as often as you can afford and do it regularly (3 times a week can be the best solution if you can’t update your site daily and are looking for the optimal update rate).

moritzbokk:
Once Google noticed that you update the content of your site regularly the crawler will come more

Navigation

[0] Message Index

[#] Next page

Go to full version