Stopping Google bot

Author Topic: Stopping Google bot  (Read 692 times)

Offline Sap SolutionTopic starter

  • Trade Count: (0)
  • Full Member
  • ***
  • Thank You 1
  • Posts: 127
  • Karma: 0
Stopping Google bot
« on: 09-29-2017, 12:16:04 »
How can we stop Google bot to visit on our website and in what cases this is requirement ?


Offline Jacob.k

  • Trade Count: (0)
  • Semi-Newbie
  • *
  • Thank You 0
  • Posts: 11
  • Karma: 0
Re: Stopping Google bot
« Reply #1 on: 09-29-2017, 18:45:34 »
You can stop it in .htaccess... Not really sure how, but you'll find that easily on google.I think it's just one or two line code... just remember to backup your htaccess file, because if you do something wrong you're screwed  :-X

Offline SEO Travis

  • Trade Count: (0)
  • Semi-Newbie
  • *
  • Thank You 0
  • Posts: 30
  • Karma: 0
  • Gender: Male
    • Visit SEO Travis
Re: Stopping Google bot
« Reply #2 on: 10-01-2017, 01:12:01 »
Well, you could try the following:

Insert into HTML <head> of website: (Could be done through WP theme)
<meta name="robots" content="noindex, nofollow">
<meta name="googlebot" content="noindex, nofollow">

or you can block with robots.txt on your website.

User-agent:GoogleBot
Disallow: /

I hope this answers your question.

Offline guitarprince

  • Trade Count: (0)
  • Semi-Newbie
  • *
  • Thank You 1
  • Posts: 28
  • Karma: 0
  • Gender: Male
    • Internet Marketing Blog
Re: Stopping Google bot
« Reply #3 on: 10-21-2017, 10:06:26 »
If you want to prevent Googlebot from crawling content on your site, you have a number of options, including using robots.txt to block access to files and directories on your server.

Once you've created your robots.txt file, there may be a small delay before Googlebot discovers your changes. If Googlebot is still crawling content you've blocked in robots.txt, check that the robots.txt is in the correct location. It must be in the top directory of the server (for example, www.example.com/robots.txt); placing the file in a subdirectory won't have any effect.

If you just want to prevent the "file not found" error messages in your web server log, you can create an empty file named robots.txt. If you want to prevent Googlebot from following any links on a page of your site, you can use the nofollow meta tag. To prevent Googlebot from following an individual link, add the rel="nofollow" attribute to the link itself.

Offline RH-Calvin

  • Trade Count: (0)
  • Hero Member
  • *****
  • Thank You 86
  • Posts: 1237
  • Karma: 0
  • Gender: Male
    • Cheap VPS Hosting
Re: Stopping Google bot
« Reply #4 on: 10-24-2017, 22:39:02 »
You can stop Googlebot by editing the robots.txt file in your website. You can disallow the webpages that you don't want to get crawled by Google.


 

Related Topics