Is it necessary to use Robots.txt?

Started by AliceFowell89, 05-18-2016, 05:25:38

Previous topic - Next topic

Kate Evans

Whenever we talk about SEO blogs, WordPress robots.txt file plays a major role in search engine ranking. It helps to block search engine bots to index and crawl important part of the blog. Robots.txt file helps search engine robots to direct which part to crawl and which part to avoid. I think it is not necessary to use Robots.txt, because your WordPress website will be indexed by search engines even without that file presence.