Seo Forum

Search Engine Optimization => SEO Basics => Topic started by: borgninestallone on 05-26-2014, 00:34:10

Title: My New Site Faces Crawling And Indexing Issues
Post by: borgninestallone on 05-26-2014, 00:34:10
I have created a new social networking site where user can upload their photos and create a community thereby. It is launched few weeks above. I have submitted my site in Google webmaster tool for indexing. But my site is not getting indexed even a single page. I have also try to fetch my site. But still i face the same problem.

When i checked for Crawl errors in Google webmaster tool, it says failed to crawl and asking to wait.

Can anyone help me in clearing this issue.?
Title: Re: My New Site Faces Crawling And Indexing Issues
Post by: Johnny on 05-26-2014, 13:04:55
- Check your robots.txt and make sure search engines are not blocked from crawling your site. If you don't have a robots.txt, make one. Not having one, won't stop search engines from indexing your site, but it's better to have one.

User-agent: *
Disallow: /


For example, the above command in the robots.txt blocks all the bots from visiting your site.

- Have you submitted a sitemap to Webmaster Tools? That also helps.
- Do a site:domain.com (or whatever TLD you have) search, and see if your site appears.

It's hard to tell what's the exact cause without a thorough investigation.