Skip to content

Commit 24de00a

Browse files
christ-offclaude
andcommitted
Document humanjson-survey bots under observation
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
1 parent f526eea commit 24de00a

1 file changed

Lines changed: 12 additions & 0 deletions

File tree

‎README.md‎

Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -563,6 +563,18 @@ casual hotlinking. Other `/assets/*` paths are intentionally unfiltered for now.
563563

564564
---
565565

566+
## Bots under observation
567+
568+
### humanjson-survey
569+
`humanjson-survey/0.3 ( https://github.com/wasabipesto-bot/humanjson; maps the human.json vouch graph; honours robots.txt)`
570+
and `humanjson-survey/0.2 (personal research crawler of the human.json vouch graph; honours robots.txt)`
571+
are **not blocked yet**: still under observation, no decision taken.
572+
573+
They crawl `/human.json` files to build a graph of human-made websites that vouch for one another
574+
as being human-made. Such a graph could be abused (e.g. to target or impersonate vouched sites).
575+
If blocked, match on the `humanjson-survey/` name token only, version dropped, per the standard
576+
pattern in [blocked-bot-regex](#blocked-bot-regex).
577+
566578
## Why a CloudFront Function (not Lambda@Edge)?
567579

568580
CloudFront Functions run at **every edge location** with sub-millisecond startup and are ~6× cheaper than Lambda@Edge. They are the right tool for stateless, CPU-light request manipulation that requires no network I/O, no large runtimes, and no response body streaming. This filter fits that profile exactly: pure string matching, no external calls.

0 commit comments

Comments
 (0)