Skip to content

[Bots, Security] Update robots.txt setting#28415

Merged
pedrosousa merged 1 commit intoproductionfrom
pedro/2026-02-18-bots-update-robots-txt
Feb 18, 2026
Merged

[Bots, Security] Update robots.txt setting#28415
pedrosousa merged 1 commit intoproductionfrom
pedro/2026-02-18-bots-update-robots-txt

Conversation

@pedrosousa
Copy link
Contributor

Summary

Doc update triggered by updated UI label.

Documentation checklist

@github-actions
Copy link
Contributor

This pull request requires reviews from CODEOWNERS as it changes files that match the following patterns:

Pattern Owners
/src/content/docs/bots/ @patriciasantaana, @cloudflare/pcx-technical-writing
* @cloudflare/pcx-technical-writing

3. Go to **robots.txt setting**.
4. Turn **robots.txt setting** on.
3. Go to **Instruct AI bot traffic with robots.txt**.
4. Turn on **Instruct AI bot traffic with robots.txt**.
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

More readable due to the long option name.

@pedrosousa pedrosousa merged commit 633da50 into production Feb 18, 2026
13 checks passed
@pedrosousa pedrosousa deleted the pedro/2026-02-18-bots-update-robots-txt branch February 18, 2026 14:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

Comments