Meta Robots Tag

Author Topic: Meta Robots Tag  (Read 3808 times)

Offline nisha03Topic starter

  • Trade Count: (0)
  • Semi-Newbie
  • *
  • Thank You 1
  • Posts: 45
  • Karma: 0
  • Gender: Female
    • Wedding planners in allahabad
Meta Robots Tag
« on: 09-19-2015, 04:26:00 »
Which is better Robots.txt or Meta Robots Tag?


Offline ToolGIR

  • Trade Count: (0)
  • Semi-Newbie
  • *
  • Thank You 3
  • Posts: 22
  • Karma: 0
    • ToolGIR.ru - All About Good Tools
Re: Meta Robots Tag
« Reply #1 on: 09-25-2015, 06:40:42 »
Robots.txt is more versatile. It allows to give various bots different instructions. It allows to give specific instructions for the whole categories, brunches etc.
Meta tag is good to give some instructions on specific page. But bots may or may not follow them, but almost all bots respect Robots.txt.

Offline Akash Varma

  • Trade Count: (0)
  • Jr. Member
  • **
  • Thank You 2
  • Posts: 99
  • Karma: 0
  • Gender: Male
    • Moving Supplies
Re: Meta Robots Tag
« Reply #2 on: 11-09-2015, 05:14:45 »
robots.txt file is far better. Once you use tag it is applicable completely to webpage. But using robots.txt certain paths in pages or folder can be blocked.

Offline jaintech

  • Trade Count: (0)
  • Full Member
  • ***
  • Thank You 10
  • Posts: 111
  • Karma: 0
  • Gender: Male
    • Website Designing Company
Re: Meta Robots Tag
« Reply #3 on: 11-12-2015, 03:53:01 »
If you forbid indexing on a URL with robots.txt, Google is not able to see the content of the page, thus no links on that URL will ever be seen and they will not be able to pass their link juice. On the other hand, if you use meta name=”robots” content=”noindex” and don’t forbid that URL through robots.txt, Google will be able to index the page, follow the links and pass the link juice, but will not be able to show the page in the search results. Hence in most cases, it’s much better decision to forbid indexing through meta tag than use robots.txt for the same purpose.

Offline Attie

  • Trade Count: (0)
  • Newbie
  • *
  • Thank You 0
  • Posts: 9
  • Karma: 0
Re: Meta Robots Tag
« Reply #4 on: 11-13-2015, 22:59:46 »
Programs. txt file will be more effective. Once you utilize point it really is relevant absolutely to be able to website. However employing programs. txt specific trails within internet pages or perhaps folder can be obstructed.
newbielink:http://easy-vsl-review.com/ [nonactive]


Offline TomClarke

  • Trade Count: (0)
  • Hero Member
  • *****
  • Thank You 50
  • Posts: 874
  • Karma: 0
  • Gender: Male
    • Custom Writing Service & Content Marketplace
Re: Meta Robots Tag
« Reply #5 on: 08-24-2016, 04:59:32 »
Robots.txt is a file placed on oyur server to tell the various search engine spiders not to crawl or index certain sections or pages of oyur site. You can use it to prevent indexing totally, prevent certain areas of oyur site from being indexes or to issue individual indexing  instructions to specific search engines.
And meta tags are useful for spiders of the search engine.
Your ideas, our writings - Writology.com

Offline SankalpPatil

  • Trade Count: (0)
  • Semi-Newbie
  • *
  • Thank You 5
  • Posts: 44
  • Karma: 0
    • File Management System
Re: Meta Robots Tag
« Reply #6 on: 09-20-2016, 03:30:37 »
The content of a robots.txt file consists of so-called "records". both "/support-desk/index.html" and "/support/index.html" as well as all other files in the "support" directory would not be indexed by search engines. If you leave the Disallow line blank, you're telling the search engine that all files may be indexed.

Offline manishaverma

  • Trade Count: (0)
  • Jr. Member
  • **
  • Thank You 4
  • Posts: 83
  • Karma: 0
  • Gender: Female
Re: Meta Robots Tag
« Reply #7 on: 09-20-2016, 04:24:50 »
Meta Robots Tag- The meta robots tags you can have on your pages has been around for quite a while. Search engines have slowly been adding features to it. This page lists an overview of all the different values you can have in your tag and its a robots.txt is a file placed on your server to tell the various search engine spiders not to crawl or index certain sections or pages of your site.
« Last Edit: 09-20-2016, 04:29:36 by manishaverma »

 

Related Topics

  Subject / Started by Replies Last post
8 Replies
3220 Views
Last post 03-14-2012, 09:59:01
by james1
15 Replies
4326 Views
Last post 03-03-2014, 05:55:34
by kumar29
3 Replies
1629 Views
Last post 09-12-2016, 01:07:58
by TomClarke
5 Replies
1404 Views
Last post 12-28-2016, 05:14:34
by rustyblogger
4 Replies
2260 Views
Last post 12-27-2016, 03:47:18
by damponting44