feat: add support for AI crawl bots#577

Merged

naorpeled merged 16 commits intomasterfrom

feat/add-ai-bots

Nov 22, 2025

Commits on Nov 22, 2025

Add support for AI crawl bots
naorpeled
committed
wip
naorpeled
committed
fixed facebook
naorpeled
committed
fixed tests
naorpeled
committed
perplexity
naorpeled
committed
wip
naorpeled
committed
wip
naorpeled
committed
wip
naorpeled
committed
webzio
naorpeled
committed
alphabetical order
naorpeled
committed
claudebot
naorpeled
committed
webzio
naorpeled
committed
perplexity
naorpeled
committed
meta
naorpeled
committed
alphabetical order
naorpeled
committed
lint
naorpeled
committed