Seo Forum

Search Engine Optimization => SEO Basics => Topic started by: nisha03 on 09-19-2015, 04:26:00

Title: Meta Robots Tag
Post by: nisha03 on 09-19-2015, 04:26:00
Which is better Robots.txt or Meta Robots Tag?
Title: Re: Meta Robots Tag
Post by: ToolGIR on 09-25-2015, 06:40:42
Robots.txt is more versatile. It allows to give various bots different instructions. It allows to give specific instructions for the whole categories, brunches etc.
Meta tag is good to give some instructions on specific page. But bots may or may not follow them, but almost all bots respect Robots.txt.
Title: Re: Meta Robots Tag
Post by: Akash Varma on 11-09-2015, 05:14:45
robots.txt file is far better. Once you use tag it is applicable completely to webpage. But using robots.txt certain paths in pages or folder can be blocked.
Title: Re: Meta Robots Tag
Post by: jaintech on 11-12-2015, 03:53:01
If you forbid indexing on a URL with robots.txt, Google is not able to see the content of the page, thus no links on that URL will ever be seen and they will not be able to pass their link juice. On the other hand, if you use meta name=”robots” content=”noindex” and don’t forbid that URL through robots.txt, Google will be able to index the page, follow the links and pass the link juice, but will not be able to show the page in the search results. Hence in most cases, it’s much better decision to forbid indexing through meta tag than use robots.txt for the same purpose.
Title: Re: Meta Robots Tag
Post by: Attie on 11-13-2015, 22:59:46
Programs. txt file will be more effective. Once you utilize point it really is relevant absolutely to be able to website. However employing programs. txt specific trails within internet pages or perhaps folder can be obstructed.
Title: Re: Meta Robots Tag
Post by: TomClarke on 08-24-2016, 04:59:32
Robots.txt is a file placed on oyur server to tell the various search engine spiders not to crawl or index certain sections or pages of oyur site. You can use it to prevent indexing totally, prevent certain areas of oyur site from being indexes or to issue individual indexing  instructions to specific search engines.
And meta tags are useful for spiders of the search engine.
Title: Re: Meta Robots Tag
Post by: SankalpPatil on 09-20-2016, 03:30:37
The content of a robots.txt file consists of so-called "records". both "/support-desk/index.html" and "/support/index.html" as well as all other files in the "support" directory would not be indexed by search engines. If you leave the Disallow line blank, you're telling the search engine that all files may be indexed.
Title: Re: Meta Robots Tag
Post by: manishaverma on 09-20-2016, 04:24:50
Meta Robots Tag- The meta robots tags you can have on your pages has been around for quite a while. Search engines have slowly been adding features to it. This page lists an overview of all the different values you can have in your tag and its a robots.txt is a file placed on your server to tell the various search engine spiders not to crawl or index certain sections or pages of your site.