Open
Description
https://en.wikipedia.org/wiki/Robots_exclusion_standard
Any request that isnt allowed by robots.txt should be reported as such.
{{ message }}
No type
No projects
No milestone
None yet
No branches or pull requests
https://en.wikipedia.org/wiki/Robots_exclusion_standard
Any request that isnt allowed by robots.txt should be reported as such.