Skip to content

Conversation

@Autoflow
Copy link

@Autoflow Autoflow commented Nov 9, 2024

Added:

  • claudebot
  • ClaudeBot
  • Bytespider
  • bytedance.com
  • facebookexternalhit

Added:
- claudebot
- ClaudeBot
- Bytespider
- bytedance\.com
- facebookexternalhit
@Cyrille37
Copy link
Contributor

Hi
AI bots should be in another list because it should be an user choice to blocks them as there are not really "bad user_agents".

@LaurenceJJones
Copy link
Member

LaurenceJJones commented Nov 7, 2025

Hi AI bots should be in another list because it should be an user choice to blocks them as there are not really "bad user_agents".

I agree, the term bad user agents is probably a bad concept all together as we cannot presume what is bad or good in the context of the user.

It would be better if we split the current bad user agents into a better contextualized fields like:

  • scanners
  • browsers

rather than "bad", cause some people may want to allow scanners why others dont.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants