We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent e75c9c7 commit 9d4717aCopy full SHA for 9d4717a
robots.txt
@@ -1,6 +1,6 @@
1
# robots.txt
2
# newtonfaq.com
3
-# updated 14 August 2025
+# updated 28 August 2025
4
5
Sitemap: https://newtonfaq.com/sitemap.xml
6
@@ -47,6 +47,7 @@ User-agent: FriendlyCrawler
47
User-agent: Gemini-Deep-Research
48
User-agent: Google-CloudVertexBot
49
User-agent: Google-Extended
50
+User-agent: Google-Firebase
51
User-agent: GoogleAgent-Mariner
52
User-agent: GoogleOther
53
User-agent: GoogleOther-Image
@@ -88,6 +89,7 @@ User-agent: SBIntuitionsBot
88
89
User-agent: Scrapy
90
User-agent: SemrushBot-OCOB
91
User-agent: SemrushBot-SWA
92
+User-agent: ShapBot
93
User-agent: Sidetrade indexer bot
94
User-agent: Thinkbot
95
User-agent: TikTokSpider
0 commit comments