Seo Forum

Search Engine Optimization => SEO Basics => Topic started by: lamnzxzfd on 12-01-2011, 23:09:06

Title: robots meta tags for SEO?
Post by: lamnzxzfd on 12-01-2011, 23:09:06
By default robots are set to index all pages of the site, So robots meta tags are never needed for a site, i wan t to know what can i do with it for better SEO?Any suggestion is welcomed! Thanks.

 
Title: Re: robots meta tags for SEO?
Post by: C.Rebecca on 12-03-2011, 00:51:34
Actually robots.txt files are placed for auto discovery of the Sitemaps.

If you place robots.txt files in your website it let major search engines in discovering your Sitemap very easily.
Title: Re: robots meta tags for SEO?
Post by: offshoreaccouting on 02-01-2012, 00:01:35
If you place robot.txt information in your website it let major google in getting your Sitemap very easily. Actually robot.txt information are placed for vehicle development of the Sitemaps.
Title: Re: robots meta tags for SEO?
Post by: seo-expert on 02-01-2012, 00:42:07
By default robots are set to index all pages of the site, So robots meta tags are never needed for a site, i wan t to know what can i do with it for better SEO?Any suggestion is welcomed! Thanks.

Exactly! Robots.txt is most needed when you want Google to not to crawl some of your site's pages otherwise its not mandatory at all.
Title: Re: robots meta tags for SEO?
Post by: matty_wllson on 02-02-2012, 09:48:30
Robots meta tag helps to search engine crawlers to crawl a website. It has two setting INDEX, FOLLOW and NOINDEX, NOFOLLOW.  1st one allows crawlers to visit whole the web page and if you put second one setting on any of the page then it will restrict to crawl it.
Title: Re: robots meta tags for SEO?
Post by: seoguro on 02-18-2012, 00:48:04
rebotex is used for restricting crawler to index any particular page of your site.
Title: Re: robots meta tags for SEO?
Post by: Ankan on 02-20-2012, 04:40:14
robots.txt is a text file webmasters create to instruct robots  on how to crawl & index pages on their website...

Thanks Regards
Ankan - http://findghar.com....
Title: Re: robots meta tags for SEO?
Post by: TM-Ali on 02-28-2012, 22:40:59
By default robots are set to index all pages of the site, So robots meta tags are never needed for a site, i wan t to know what can i do with it for better SEO?Any suggestion is welcomed! Thanks.

With Meta Robots you can block any web page from being indexed in Search Engine's data base by applying following meta robot code before closing of </head>.

<meta name="robots" content="no follow, no index"/>
Title: Re: robots meta tags for SEO?
Post by: Davidadams on 02-29-2012, 22:44:47
The Robots META Tag is meant to provide users who cannot upload or control the /robots.txt file at their websites, with a last chance to keep their content out of search engine indexes and services.

<meta name="robots" content="robots-terms">
Title: Re: robots meta tags for SEO?
Post by: robinhood005 on 03-01-2012, 02:06:04

If you place computerized automated automated automatic robot.txt information in your website it let considerable the the google in getting your Sitemap very easily. Actually computerized automated automated automatic robot.txt information are placed for car development of the Sitemaps.
Title: Re: robots meta tags for SEO?
Post by: AnnaKovac on 03-07-2012, 01:13:33
hello friend !!
There are two important considerations when using the robots <META> tag:
    * robots can ignore your <META> tag. Especially malware robots that scan the web for security vulnerabilities, and email address harvesters used by spammers will pay no attention.
    * the NOFOLLOW directive only applies to links on this page. It's entirely likely that a robot might find the same links on some other page without a NOFOLLOW (perhaps on some other site), and so still arrives at your undesired page.
thanks.............

Title: Re: robots meta tags for SEO?
Post by: globalseo on 03-24-2012, 03:58:52
The robots exclusion protocol (REP), or robots.txt is a text file webmasters create to instruct robots (typically search engine robots) on how to crawl & index pages on their website. Ex.<meta name="robots" content="robots-terms">
Title: Re: robots meta tags for SEO?
Post by: seoguro on 03-24-2012, 04:40:21
rebots file is use to stop crawler for crawling on page.
Title: Re: robots meta tags for SEO?
Post by: emedianetwork on 10-08-2013, 01:33:24
By default, all pages are indexed and followed, but if you want to stop indexing a page or set of pages or even a folder, it can be done through Robots.txt file. When we set a page or folder no index, keep it very carefully..  >:D
Title: Re: robots meta tags for SEO?
Post by: Derickalex on 10-08-2013, 07:00:55
Must include <meta name="robots" content="follow, index"/> within header of homepage and innerpages to let search engine index and follow your webpage
Title: Re: robots meta tags for SEO?
Post by: kumar29 on 03-03-2014, 05:55:34
The robots meta tag helps the search engines to index your Website. It also tells the search engines what directories/files you do not want them to index. Along with the robots meta tag you have to create a “robots.txt” file and upload it to the root directory of your site.