Seo Forum

Search Engines => Google Search Optimization => Topic started by: tmcconnell on 05-15-2012, 16:51:48

Title: Google Crawl rate
Post by: tmcconnell on 05-15-2012, 16:51:48
What does everyone with dynamically updated websites set their crawl rate to? I don't want to waste too much bandwidth on googlebot but want recent caches in google.
Title: Re: Google Crawl rate
Post by: moritzbokk on 08-07-2012, 08:34:18
it's a myth that you can determine when google's bots should come to crawl your site. It doesn't work
I mean think about it, people would say the bots they should come every 30 minutes
Title: Re: Google Crawl rate
Post by: cisritu on 08-21-2012, 06:49:23
What does everyone with dynamically updated websites set their crawl rate to? I don't want to waste too much bandwidth on googlebot but want recent caches in google.

I think we can not escape to an easy alternative or any things such as called  tricks.  People do use trick but using tricks is a risky task!
If you want your site to crawled faster you have compromise with the bandwidth.
Title: Re: Google Crawl rate
Post by: Allenbrayan on 08-28-2012, 04:43:15
You need to update your content often and regularly (and ping Google once you do). Try to add new unique content as often as you can afford and do it regularly (3 times a week can be the best solution if you can’t update your site daily and are looking for the optimal update rate).
Title: Re: Google Crawl rate
Post by: moritzbokk on 08-29-2012, 05:11:48
Once Google noticed that you update the content of your site regularly the crawler will come more
Title: Re: Google Crawl rate
Post by: seoguru7 on 08-29-2012, 07:47:46
Google is crawling  your site on the basis of traffic, pagerank, Updates, Your website's quality and Content etc.... There are other factors also but it is not revealed yet. I am also looking forward to it.
Title: Re: Google Crawl rate
Post by: ZabBZaa on 09-09-2012, 10:47:54
Regular and frequent visits by the crawler is the first sign that your site appeals to Google. Thus the most efficient way to get frequent and deep crawls is to develop a website that search engines see as important and valuable.

Note that you can’t force Googlebot to visit you more often – what you can do is to invite it to come. Possible measures to take to increase the crawl rate may include:

Title: Re: Google Crawl rate
Post by: brandsmith on 09-11-2012, 04:17:27
If you are looking for fast crawling rate then you must update fresh content that entice to every visitors read up to down and also give provide best information related their search query.
Title: Re: Google Crawl rate
Post by: GMT on 09-11-2012, 14:14:20
I know that googlebot tends to ignore the refresh time in sitemaps so yeah as others said you can't really determine how often googlebot will crawl your content. Though if your site is popular or you ping google upon updates(say for a blog) it can increase the frequency. I had a blog that Googlebot visited constantly daily.
Title: Re: Google Crawl rate
Post by: apsarabanu on 09-14-2012, 05:40:22
Hi everyone,
           If you have a high crawl rate, it means you have lots of fresh content that will be added to Google’s index fast, i think if you have a way to make minor changes to all your pages frequently, you will see the crawl rate increase.
Title: Re: Google Crawl rate
Post by: johnkelvin1011 on 09-26-2012, 20:24:05
Hi,

If you want also to ensure that google will crawl your site, you can use google webmasters tool to submit the url of your site. :)
Title: Re: Google Crawl rate
Post by: oliviasrodriguez on 09-26-2012, 22:09:54
Hi,

If you want also to ensure that google will crawl your site, you can use google webmasters tool to submit the url of your site. :)
Google webmastertool is best for google crawl rate. You can also use bing webmastertools for their search engine.
Title: Re: Google Crawl rate
Post by: rosicky on 10-06-2012, 13:29:42
 if your site is popular or you ping google upon updates(say for a blog) it can increase the frequency. I had a blog that Googlebot visited constantly daily.
Title: Re: Google Crawl rate
Post by: rogerlucas on 10-07-2012, 07:49:13
Quote
Once Google noticed that you update the content of your site regularly the crawler will come more

Nice information you are provide us ..
Title: Re: Google Crawl rate
Post by: BUM on 01-10-2013, 05:23:16
Google Crawlers consider various things such as page authority, domain authority, page rank, traffic and various other things. If you add unique content every day on your website then the crawler will increase the crawling of your webpage.
Title: Re: Google Crawl rate
Post by: jayanta1 on 01-16-2013, 00:26:57
Regular and frequent visits by the crawler is the first sign that your site appeals to Google. Thus the most efficient way to get frequent and deep crawls is to develop a website that search engines see as important and valuable.

To increase your crawling rate you need to do:

1) Update your content often and regularly
2) no duplicate content
3) Adjust the crawl speed
Title: Re: Google Crawl rate
Post by: masterjohn321 on 01-22-2013, 12:47:27
 Crawling rate is basically depends on how often you update content on website, if you update content according to your crawling rate then there is not an issue but if you are not updating your content accordingly then Google can decrease your crawling rate.
Title: Re: Google Crawl rate
Post by: quain88 on 01-24-2013, 20:57:54
google crawl my site like every now and then and besides, google crawl your sitemap, whats new on your sitemap will be indexed, not all content on your site will be indexed, its a waste of time and resources to google, thats how useful a sitemap is
Title: Re: Google Crawl rate
Post by: damponting44 on 01-17-2018, 22:37:24
The technical reasons for Google to crawl your site slowly can be divided into three groups: your site is too slow, you have too many errors, or you have too many URLs.