Checking for no-follow and robots.txt

Author Topic: Checking for no-follow and robots.txt  (Read 3550 times)

Offline oleshkaTopic starter

  • Trade Count: (0)
  • Semi-Newbie
  • *
  • Thank You 2
  • Posts: 48
  • Karma: 1
    • Фильмы по профессиональному Боксу
Checking for no-follow and robots.txt
« on: 05-23-2010, 15:05:39 »
I have an opportunity to exchange links with another site owner but I would like to check to make sure the link he leaves me will pass link juice. Is there a way to check for robots.txt?


Offline Charter

  • Trade Count: (0)
  • Semi-Newbie
  • *
  • Thank You 2
  • Posts: 36
  • Karma: 1
Re: Checking for no-follow and robots.txt
« Reply #1 on: 06-07-2010, 12:56:11 »
Just download robots.txt and you will see if it's prohibited.


Offline priya.du

  • Trade Count: (0)
  • Semi-Newbie
  • *
  • Thank You 0
  • Posts: 16
  • Karma: 0
  • Gender: Female
    • Ducat Noida
Re: Checking for no-follow and robots.txt
« Reply #2 on: 12-07-2023, 03:01:26 »
Yes, you can check if the link is nofollow or dofollow because Dofollow pass the link juice.
For checking robots.txt, you can use tool or use /robots.txt after the domain name.

Offline rahul verma

  • Trade Count: (0)
  • Full Member
  • ***
  • Thank You 1
  • Posts: 110
  • Karma: 0
    • Work from home
Re: Checking for no-follow and robots.txt
« Reply #3 on: 02-06-2024, 03:27:13 »
You will use NoIndex when instructing a search engine not to store your web page for display in search results while you will use NoFollow when you are instructing search engine crawlers not to follow the links that are on your page.

 

Related Topics

  Subject / Started by Replies Last post
6 Replies
6345 Views
Last post 08-12-2011, 02:43:04
by Anthony696
12 Replies
10406 Views
Last post 11-15-2013, 22:34:34
by Chris_Tax
18 Replies
7639 Views
Last post 05-17-2013, 12:51:07
by takidaki
22 Replies
11173 Views
Last post 08-12-2014, 03:56:36
by stonewood
1 Replies
1402 Views
Last post 09-26-2016, 05:19:05
by alex.thomson