Search Engine Optimization > SEO Basics

What is the limit of a robot.txt file?

<< < (2/2)

smartscraper:
So the final answer is "Google has a limit of only being able to process up to 500KB of your robots.txt file"

bejandaruwalla:
There is a limit to what Google is able to process only up to 500KB of your robots.txt file.

laragiles2021:
It reads only the first 500kb present in the robots.txt file.

Kerry_Watson2:
500 kibibyte limit on robots.txt files (KiB). Content that exceeds the file size limit is disregarded. You can shrink the robots in size.

Navigation

[0] Message Index

[*] Previous page

Go to full version