Skip to content

docs: add llms.txt, page descriptions, and edit links - #4037

Open
Giri-Aayush wants to merge 1 commit into
NethermindEth:mainfrom
Giri-Aayush:docs/agent-readiness
Open

docs: add llms.txt, page descriptions, and edit links#4037
Giri-Aayush wants to merge 1 commit into
NethermindEth:mainfrom
Giri-Aayush:docs/agent-readiness

Conversation

@Giri-Aayush

Copy link
Copy Markdown
Contributor

Make the docs readable by agents and findable by search.

Reason

Most of our docs traffic is agents, and today they get nothing built for them: no llms.txt, no raw markdown, no page descriptions. This adds an llms.txt index, an llms-full.txt, and a raw .md beside every page (served as text/markdown), generated on every build from the published version. The same one-line description per page feeds both the llms.txt index and the HTML meta tag search engines quote. Also adds edit links, real last-updated dates, and a robots.txt.

@codecov

codecov Bot commented Sep 4, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 79.18%. Comparing base (121146c) to head (95114ac).
⚠️ Report is 1 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #4037      +/-   ##
==========================================
- Coverage   79.31%   79.18%   -0.14%     
==========================================
  Files         464      464              
  Lines       35793    35787       -6     
==========================================
- Hits        28389    28337      -52     
- Misses       7395     7441      +46     
  Partials        9        9              

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@rodrodros

Copy link
Copy Markdown
Contributor

Most of our docs traffic is agents

Do you have the docs traffic by chance?

Comment thread docs/plugins/llms-txt.js

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This file should maybe have unit tests?

Comment thread docs/docusaurus.config.js
Comment on lines +50 to 54
// Edit links point at docs/ (next) so fixes land where they flow forward.
editUrl: "https://github.com/NethermindEth/juno/edit/main/docs/",
editCurrentVersion: true,
showLastUpdateTime: true,
},

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why is this for?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants