Skip to content

Improve robots.txt #9729

@begonaalvarezd

Description

@begonaalvarezd

We currently allow everything and we should think what we really want to enable, since we use amplitude we should come up with a better robots.txt to discourage crawlers and AI scrapers

Metadata

Metadata

Assignees

No one assigned

    Labels

    explorerIssues related to the ExplorertoolingIssues related to the Tooling team

    Type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions