Checking for no-follow and robots.txt

Author Topic: Checking for no-follow and robots.txt  (Read 1785 times)

Offline oleshkaTopic starter

  • Trade Count: (0)
  • Semi-Newbie
  • *
  • Thank You 1
  • Posts: 48
  • Karma: 1
    • Фильмы по профессиональному Боксу
Checking for no-follow and robots.txt
« on: 05-23-2010, 15:05:39 »
I have an opportunity to exchange links with another site owner but I would like to check to make sure the link he leaves me will pass link juice. Is there a way to check for robots.txt?


Offline Charter

  • Trade Count: (0)
  • Semi-Newbie
  • *
  • Thank You 1
  • Posts: 36
  • Karma: 1
Re: Checking for no-follow and robots.txt
« Reply #1 on: 06-07-2010, 12:56:11 »
Just download robots.txt and you will see if it's prohibited.

 

Related Topics

  Subject / Started by Replies Last post
6 Replies
3527 Views
Last post 08-12-2011, 02:43:04
by Anthony696
12 Replies
5246 Views
Last post 11-15-2013, 22:34:34
by Chris_Tax
18 Replies
4983 Views
Last post 05-17-2013, 12:51:07
by takidaki
22 Replies
8752 Views
Last post 08-12-2014, 03:56:36
by stonewood
1 Replies
765 Views
Last post 09-26-2016, 05:19:05
by alex.thomson