Proposal: opt-in tooling to generate an offline, searchable project dataset (with a parsing bug fix) #6564
paulstuart
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Hi — first, thanks for maintaining awesome-go.
I've been building a Go project and wanted to consult the full list programmatically — to check whether a well-maintained library already exists before writing my own — without scraping the README each time. I put together an opt-in tool that turns the README into a structured
projects.jsonland wanted to gauge whether there's interest before proposing anything, since I know this falls outside the single-item-PR model.What it does
cmd/gatherbinary, never modifiesREADME.md, and doesn't touch the site build or CI.A bug I found along the way (useful on its own)
While reusing the extraction code, I hit the
NextFilteredUntil("ul", "h2")FIXME: each sub-category heading swallows the link lists of every following sub-category until the next top-level##, so projects get duplicated across categories (one project appeared under 14 categories). This also affects the generated per-category pages. The fix bounds each heading to the next heading of any level. I'm happy to submit that as a standalone bug-fix PR independent of the tooling, if you'd find it useful.Reference implementation: https://github.com/paulstuart/awesome-go/tree/complete-vitality (structured as two commits — the bug fix first, the tooling second).
Would there be interest in any part of this — the bug fix, the tooling, or the dataset? Entirely understand if it's out of scope. Thanks!
All reactions