Skip to content

Commit 1f9a43e

Browse files
committed
Update robots.txt to include Content-Signal and specify PetalBot disallow rules
1 parent 496b1e9 commit 1f9a43e

1 file changed

Lines changed: 4 additions & 1 deletion

File tree

public/robots.txt

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,6 @@
1+
Sitemap: https://vtbag.dev/sitemap-index.xml
12
User-agent: *
3+
Content-Signal: ai-train=no, search=yes
24
Allow: /
35
Disallow: /auto/
46
Disallow: /backdrop-demo/
@@ -13,4 +15,5 @@ Disallow: /forge/
1315
Disallow: /inspection-chamber-demo/
1416
Disallow: /tests/
1517
Disallow: /tmp/
16-
Sitemap: https://vtbag.dev/sitemap-index.xml
18+
User-agent: PetalBot
19+
Disallow: /

0 commit comments

Comments
 (0)