Which is better Robots.txt or Meta Robots Tag?

Author Topic: Which is better Robots.txt or Meta Robots Tag?  (Read 323 times)

Offline kalmakuranTopic starter

  • Trade Count: (0)
  • Semi-Newbie
  • *
  • Thank You 0
  • Posts: 21
  • Karma: 0
    • Islamic Wazifa for Love
Which is better Robots.txt or Meta Robots Tag?
« on: 08-29-2016, 00:54:32 »
Hello friends,

 I Want TO know that Which is better Robots.txt or Meta Robots Tag?


Offline AmarInfotech

  • Trade Count: (0)
  • Semi-Newbie
  • *
  • Thank You 0
  • Posts: 31
  • Karma: 0
  • Gender: Male
  • We knows Whats better
    • Web Development Company in INDIA
Re: Which is better Robots.txt or Meta Robots Tag?
« Reply #1 on: 08-30-2016, 23:41:02 »
Robots meta tag gives option that crawl or not crawl specific page.It also informs about do-follow and no-follow links on the web page.whereas robots.txt is a list of a directories which mainly used for restriction about crawling of a specific web pages.so both used for different purposes and not better than each other.
Amarinfotech is an IT development company that offers SEO services in Sydney and helps to a webmaster to solve their issue.

Offline RH-Calvin

  • Trade Count: (0)
  • Hero Member
  • *****
  • Thank You 52
  • Posts: 1018
  • Karma: -1
  • Gender: Male
    • Cheap VPS Hosting
Re: Which is better Robots.txt or Meta Robots Tag?
« Reply #2 on: 08-31-2016, 00:37:21 »
Robots.txt is a text file that lists webpages which contain instructions for search engines robots. The file lists webpages that are allowed and disallowed from search engine crawling.

Offline TomClarke

  • Trade Count: (0)
  • Hero Member
  • *****
  • Thank You 17
  • Posts: 896
  • Karma: 0
  • Gender: Male
    • Custom Writing Service & Content Marketplace
Re: Which is better Robots.txt or Meta Robots Tag?
« Reply #3 on: 08-31-2016, 00:48:32 »
The meta tags option tells bots not to index individual files, whereas robots.txt can be used to restrict access to entire directories.
Sure, use A meta tag if you have the odd page in indexed folders that you want skipping, but generally, I would recommend you most of your non-indexed content in one or more folders and use robots.txt to skip the lot.
No, there isn't a problem in using both - if there is a  clash, in general terms, a deny will overrule an allow.
Your ideas, our writings - Writology.com

 

Related Topics

  Subject / Started by Replies Last post
8 Replies
2527 Views
Last post 03-14-2012, 09:59:01
by james1
15 Replies
3136 Views
Last post 03-03-2014, 05:55:34
by kumar29
24 Replies
3330 Views
Last post 05-10-2012, 01:38:00
by ring2012
3 Replies
1159 Views
Last post 09-12-2016, 01:07:58
by TomClarke
8 Replies
3193 Views
Last post 09-20-2016, 04:24:50
by manishaverma