feat: Add llms.txt for AI/LLM discoverability - #131
Merged
Conversation
This adds llms.txt files following the llmstxt.org specification to improve Bacalhau documentation visibility in AI systems like ChatGPT, Claude, Perplexity, and other LLMs. ## What's included: - `/llms.txt` - Navigation index with quick start guide - `/llms/getting-started.txt` - Installation and first job tutorials - `/llms/cli.txt` - Complete CLI command reference - `/llms/api.txt` - REST API documentation - `/llms/concepts.txt` - Architecture and core concepts - `/llms/other.txt` - Additional documentation - `/robots.txt` - Updated with LLMs-Txt directive - `/.well-known/mcp.json` - MCP server discovery for AI tool integration ## Why this matters: - AI search traffic grew 527% YoY while traditional search grew only 4% - ChatGPT has 800M+ weekly users asking questions about tools like Bacalhau - Without llms.txt, AI systems may hallucinate or miss accurate documentation ## Token counts (optimized for context windows): - llms.txt: 373 tokens - cli.txt: 14,297 tokens - api.txt: 8,498 tokens - getting-started.txt: 1,948 tokens - concepts.txt: 1,625 tokens 🤖 Generated with [Claude Code](https://claude.ai/claude-code) Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
aronchick
marked this pull request as ready for review
December 27, 2025 21:42
aronchick
enabled auto-merge
December 27, 2025 21:42
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
This PR adds llms.txt files following the llmstxt.org specification to improve Bacalhau documentation visibility in AI systems like ChatGPT, Claude, Perplexity, and other LLMs.
What's included
/llms.txt/llms/getting-started.txt/llms/cli.txt/llms/api.txt/llms/concepts.txt/llms/other.txt/robots.txt/.well-known/mcp.jsonWhy this matters
How it works
/llms.txtfor navigation/llms/cli.txt)Test plan
🤖 Generated with Claude Code