where to load Robots.txt in Appache webserver

Started by Selvakumar, 10-06-2013, 23:28:35

Previous topic - Next topic

SelvakumarTopic starter

Hi experts

  i am having one call logging portal(Redmine), i configured through Apache web server, but my content in the application coming in google search, i created robots.txt to disallow the conent, i dont know where to load robots.txt file in server,

please help me.

Thanks

Selva
  •  


hainvv

#1
To load the robots.txt file in your server, you can follow these steps:

1. Create a text file named "robots.txt" on your local machine.
2. Add the necessary directives to disallow the content from being indexed by search engines. For example:
   User-agent: *
   Disallow: /
   This will instruct search engine crawlers not to index any content on your site.

3. Once the robots.txt file is created, you need to upload it to the root directory of your web server. If you're using Apache, this is typically the public_html or www directory.

4. Use an FTP client or any file manager provided by your hosting provider to upload the robots.txt file to the root directory of your website.

5. Verify that the robots.txt file is accessible by visiting http://yourdomain.com/robots.txt in a web browser, replacing "yourdomain.com" with your actual domain name.

The goal of any SEO activity is to be prominently featured in the SERPs, otherwise known as search engine ranking pages. Having a pin-kickin' Pinterest page can help boost your page to the front of the branded searches. If photos, recipes, and other uber pin-able items are key drivers for your biz, then you would love to have your Pinterest profile on page one. Whole Foods is a rocking example of a company that's doing just that. Their Pinterest page is ranked 5th when you search "Whole Foods." Not too shabby, and they're obviously doing something right because they have over 150k followers. Without a doubt, Pinterest is a huge traffic driver for the organic and natural food company.