Which is better Robots.txt or Meta Robots Tag?

Author Topic: Which is better Robots.txt or Meta Robots Tag?  (Read 1167 times)

Offline kalmakuranTopic starter

  • Trade Count: (0)
  • Jr. Member
  • **
  • Thank You 2
  • Posts: 68
  • Karma: 0
    • Islamic Wazifa for Love
Which is better Robots.txt or Meta Robots Tag?
« on: 08-29-2016, 00:54:32 »
Hello friends,

 I Want TO know that Which is better Robots.txt or Meta Robots Tag?


Offline AmarInfotech

  • Trade Count: (0)
  • Semi-Newbie
  • *
  • Thank You 3
  • Posts: 35
  • Karma: 0
  • Gender: Male
  • We knows Whats better
    • Web Development Company in INDIA
Re: Which is better Robots.txt or Meta Robots Tag?
« Reply #1 on: 08-30-2016, 23:41:02 »
Robots meta tag gives option that crawl or not crawl specific page.It also informs about do-follow and no-follow links on the web page.whereas robots.txt is a list of a directories which mainly used for restriction about crawling of a specific web pages.so both used for different purposes and not better than each other.
Amar Infotech is a Laravel development company provides efficient Laravel development services at affordable rates.

Offline RH-Calvin

  • Trade Count: (0)
  • Hero Member
  • *****
  • Thank You 84
  • Posts: 1198
  • Karma: 0
  • Gender: Male
    • Cheap VPS Hosting
Re: Which is better Robots.txt or Meta Robots Tag?
« Reply #2 on: 08-31-2016, 00:37:21 »
Robots.txt is a text file that lists webpages which contain instructions for search engines robots. The file lists webpages that are allowed and disallowed from search engine crawling.

Offline TomClarke

  • Trade Count: (0)
  • Hero Member
  • *****
  • Thank You 48
  • Posts: 893
  • Karma: 0
  • Gender: Male
    • Custom Writing Service & Content Marketplace
Re: Which is better Robots.txt or Meta Robots Tag?
« Reply #3 on: 08-31-2016, 00:48:32 »
The meta tags option tells bots not to index individual files, whereas robots.txt can be used to restrict access to entire directories.
Sure, use A meta tag if you have the odd page in indexed folders that you want skipping, but generally, I would recommend you most of your non-indexed content in one or more folders and use robots.txt to skip the lot.
No, there isn't a problem in using both - if there is a  clash, in general terms, a deny will overrule an allow.
Your ideas, our writings - Writology.com

Offline wellliving

  • Trade Count: (0)
  • Full Member
  • ***
  • Thank You 7
  • Posts: 162
  • Karma: 0
    • Well-living-shop
Re: Which is better Robots.txt or Meta Robots Tag?
« Reply #4 on: 12-28-2016, 03:47:42 »
i think robots.txt is better than meta robot. in robots.txt search engines get all information in a file. so we should go with robots.txt.


Offline rustyblogger

  • Trade Count: (0)
  • Full Member
  • ***
  • Thank You 9
  • Posts: 103
  • Karma: 0
  • Gender: Male
  • Love Live Life
    • Rusty Blogger- Internet Marketing Tips, Tricks and Tactics
Re: Which is better Robots.txt or Meta Robots Tag?
« Reply #5 on: 12-28-2016, 05:14:34 »
Both are good and used according to requirements........ :)

 

Related Topics

  Subject / Started by Replies Last post
8 Replies
2988 Views
Last post 03-14-2012, 09:59:01
by james1
15 Replies
3832 Views
Last post 03-03-2014, 05:55:34
by kumar29
3 Replies
1483 Views
Last post 09-12-2016, 01:07:58
by TomClarke
7 Replies
3655 Views
Last post 09-20-2016, 04:24:50
by manishaverma
4 Replies
2061 Views
Last post 12-27-2016, 03:47:18
by damponting44