Which is better Robots.txt or Meta Robots Tag?

Author Topic: Which is better Robots.txt or Meta Robots Tag?  (Read 2253 times)

Offline bababangaliTopic starter

  • Trade Count: (0)
  • Jr. Member
  • **
  • Thank You 0
  • Posts: 51
  • Karma: 0
    • Vashikaran Specialist babaji
Which is better Robots.txt or Meta Robots Tag?
« on: 12-26-2016, 05:32:56 »
Hello friends,

Which is better Robots.txt or Meta Robots Tag?


Offline SamJ

  • Trade Count: (0)
  • Semi-Newbie
  • *
  • Thank You 4
  • Posts: 20
  • Karma: 0
    • JeRetiens - Trucs mnémotechniques
Re: Which is better Robots.txt or Meta Robots Tag?
« Reply #1 on: 12-26-2016, 07:14:48 »
Hello,

The Meta tag option tells bots not to index individual files, whereas Robots.txt can be used to restrict access to entire directories and also show them the sitemap location.

I suggest you to write a robots.txt file.

You can also combine tags & robots.txt for your needs.

More informations here: https://www.weareinfront.com/learn-article/robots_txt/
Mnemonics devices addict ? Check out https://jeretiens.net   O0

Offline luffy268

  • Trade Count: (0)
  • Jr. Member
  • **
  • Thank You 8
  • Posts: 98
  • Karma: 0
    • Haki Review
Re: Which is better Robots.txt or Meta Robots Tag?
« Reply #2 on: 12-27-2016, 01:57:13 »
If you are trying to improve SEO it's ok to use both. You may want to and noindex with meta for the RSS feed, all back-end pages, comments and other pages without important content.

Offline EnKonversations

  • Trade Count: (0)
  • Semi-Newbie
  • *
  • Thank You 3
  • Posts: 12
  • Karma: 0
  • Gender: Male
  • internet marketing company in mumbai
    • EnKonversations - Interactive Marketing
Re: Which is better Robots.txt or Meta Robots Tag?
« Reply #3 on: 12-27-2016, 02:59:29 »
Robots.txt works fine, but keep in mind settings within robots.txt are just guidelines for search engines. They can choose to ignore them, so don't use this as a way to secure/hide web pages.

robots.txt file is a publicly available file. Anyone can see what sections of your server you don't want robots to use.
whereas meta tag ,you have to provide allow!/disallow to read the content of your web page !!bu default allow exists
EnKonversations [nofollow]

Offline damponting44

  • Trade Count: (0)
  • Sr. Member
  • ****
  • Thank You 18
  • Posts: 396
  • Karma: 0
  • Gender: Male
    • Mobisoft Infotech
Re: Which is better Robots.txt or Meta Robots Tag?
« Reply #4 on: 12-27-2016, 03:47:18 »
The purpose of a robots.txt file, also known as the robots exclusion protocol, is to give webmasters control over what pages robots (commonly called spiders) can crawl and index on their site. A typical robots.txt file, placed on your site’s server, should include your sitemap’s URL and any other parameters you wish to put in place.


 

Related Topics

  Subject / Started by Replies Last post
8 Replies
3217 Views
Last post 03-14-2012, 09:59:01
by james1
15 Replies
4314 Views
Last post 03-03-2014, 05:55:34
by kumar29
3 Replies
1618 Views
Last post 09-12-2016, 01:07:58
by TomClarke
7 Replies
3800 Views
Last post 09-20-2016, 04:24:50
by manishaverma
5 Replies
1393 Views
Last post 12-28-2016, 05:14:34
by rustyblogger