Is it necessary to use Robots.txt?

Author Topic: Is it necessary to use Robots.txt?  (Read 4147 times)

Offline Kate Evans

  • Trade Count: (0)
  • Sr. Member
  • ****
  • Thank You 17
  • Posts: 343
  • Karma: 0
Re: Is it necessary to use Robots.txt?
« Reply #10 on: 05-27-2016, 03:16:06 »
Whenever we talk about SEO blogs, WordPress robots.txt file plays a major role in search engine ranking. It helps to block search engine bots to index and crawl important part of the blog. Robots.txt file helps search engine robots to direct which part to crawl and which part to avoid. I think it is not necessary to use Robots.txt, because your WordPress website will be indexed by search engines even without that file presence.


 

Related Topics

  Subject / Started by Replies Last post
24 Replies
4952 Views
Last post 05-10-2012, 01:38:00
by ring2012
31 Replies
10607 Views
Last post 04-24-2016, 20:52:14
by nguyenmailan
10 Replies
2706 Views
Last post 11-29-2012, 04:09:32
by seocyrusjpr
17 Replies
6743 Views
Last post 04-19-2014, 00:47:04
by ComoliWesta
11 Replies
4379 Views
Last post 10-05-2016, 06:39:48
by mukeshkr