Skip to content

Commit acef547

Browse files
committed
feat: 添加 archive.org_bot 到 robots.txt 以支持网页归档
1 parent 66ac4f6 commit acef547

1 file changed

Lines changed: 2 additions & 0 deletions

File tree

src/public/robots.txt

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -21,6 +21,8 @@ User-agent: adidxbot
2121
# apple.com search engine
2222
User-agent: Applebot
2323
user-agent: AppleNewsBot
24+
# archive.org web archive
25+
User-agent: archive.org_bot
2426
# baidu.com chinese search engine
2527
User-agent: Baiduspider
2628
User-agent: Baiduspider-image

0 commit comments

Comments
 (0)