You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: source/d4034-wg21-sage.md
+14-14Lines changed: 14 additions & 14 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -352,7 +352,7 @@ Modern AI capabilities make this project feasible in ways that weren't possible
352
352
-**Structured extraction**: Converting narrative knowledge into organized frameworks
353
353
-**Accessibility**: Making captured knowledge searchable and navigable
354
354
355
-
We have developed an agentic knowledge extraction framework ([WG21_CAPTURE.md](https://github.com/cppalliance/wg21-capturing-knowledge/blob/master/rules/WG21_CAPTURE.md)) that processes interview transcripts and produces structured output distinguishing:
355
+
We have developed an agentic knowledge extraction framework ([WG21_CAPTURE.md](https://github.com/cppalliance/wg21-sage/blob/master/rules/WG21_CAPTURE.md)) that processes interview transcripts and produces structured output distinguishing:
356
356
357
357
-**Principles**: Distilled, actionable rules that can be applied to evaluate new proposals
358
358
-**Experiences**: Supporting stories that illustrate and validate the principles
@@ -382,7 +382,7 @@ The economics are clear: judgment is the bottleneck owned by experts. This metho
382
382
383
383
## 5. Experimental Results
384
384
385
-
We conducted interviews with experienced committee members and processed the results through the agentic workflow described above. The full transcripts, synthesized knowledge files, and the agentic extraction rule are available in the [GitHub repository](https://github.com/cppalliance/wg21-capturing-knowledge).
385
+
We conducted interviews with experienced committee members and processed the results through the agentic workflow described above. The full transcripts, synthesized knowledge files, and the agentic extraction rule are available in the [GitHub repository](https://github.com/cppalliance/wg21-sage).
386
386
387
387
The summaries below are AI-generated syntheses. They have not yet undergone full interviewee review. See Section 1 (Disclosure) for the applicable caveats.
388
388
@@ -402,7 +402,7 @@ Matheus also articulates a tension between library and language features: founda
402
402
- The committee should throttle feature adoption based on available implementation capacity; approving features faster than they can be implemented wastes resources
403
403
- Rationale discussed orally in study groups is often lost because it's not recorded in papers; however, requiring authors to document every objection may be counterproductive—papers typically address concerns with measurable consensus impact
@@ -450,7 +450,7 @@ He also provides a foundational account of how consensus-based collaboration can
450
450
- Effective technical leadership means moderating discussions so all arguments are heard, remaining non-partisan toward solutions; Beman Dawes's ecumenical leadership style created a level of respect that attracted high-caliber contributors
451
451
- The best technical work uncovers existing truths rather than creating arbitrary constructs; approach problems as exploration toward the right answer, not competition between proposed solutions
### 5.4 Sean Parent (From Existing Documentary Footage)
456
456
@@ -469,7 +469,7 @@ Parent articulates a principle about documented rationale: "Every decision that
469
469
- Standards bodies benefit from documenting rationale for decisions and maintaining explicit design principles; this improves consistency across similar decisions
470
470
- Meta-programming should be implementation technique for library authors, not exposed interface; Stepanov always viewed it as "a hack so he could implement generic programming"
@@ -495,7 +495,7 @@ They describe carrying these lessons forward to Swift. Chris Lattner deliberatel
495
495
- New languages or features benefit from deliberate instability periods where breaking changes are expected, allowing real-world learning before permanent commitment
496
496
- Languages need external proving grounds (like Boost was for C++) where ideas can be tested extensively before standardization; the committee structure itself cannot serve this function
**Stage 1 - Capture.**[WG21_CAPTURE.md](https://github.com/cppalliance/wg21-capturing-knowledge/blob/master/rules/WG21_CAPTURE.md) is a knowledge extraction agent. Given an interview transcript, it produces a structured knowledge file containing principles (actionable rules with "When to Apply" conditions and "Red Flags" for violations) and experiences (supporting stories that illustrate and validate the principles). Each principle carries metadata: category, confidence level, and whether it applies to library proposals, language proposals, or both. We applied `WG21_CAPTURE` to each of the five transcripts in `inputs/`, producing five knowledge files in `knowledge/`.
516
+
**Stage 1 - Capture.**[WG21_CAPTURE.md](https://github.com/cppalliance/wg21-sage/blob/master/rules/WG21_CAPTURE.md) is a knowledge extraction agent. Given an interview transcript, it produces a structured knowledge file containing principles (actionable rules with "When to Apply" conditions and "Red Flags" for violations) and experiences (supporting stories that illustrate and validate the principles). Each principle carries metadata: category, confidence level, and whether it applies to library proposals, language proposals, or both. We applied `WG21_CAPTURE` to each of the five transcripts in `inputs/`, producing five knowledge files in `knowledge/`.
517
517
518
-
**Stage 2 - Merge.**[WG21_MERGE.md](https://github.com/cppalliance/wg21-capturing-knowledge/blob/master/rules/WG21_MERGE.md) is a knowledge merging agent. Given multiple knowledge files, it identifies principles that appear in two or more independent sources, intelligently merges them into a single statement, and discards principles corroborated by only one source. The merged principles are written in a concise style with "Examples of" and "Counterexamples" lists drawn from the source material. We applied `WG21_MERGE` to the five knowledge files, producing [merged.know.md](https://github.com/cppalliance/wg21-capturing-knowledge/blob/master/knowledge/merged.know.md) containing 11 merged principles.
518
+
**Stage 2 - Merge.**[WG21_MERGE.md](https://github.com/cppalliance/wg21-sage/blob/master/rules/WG21_MERGE.md) is a knowledge merging agent. Given multiple knowledge files, it identifies principles that appear in two or more independent sources, intelligently merges them into a single statement, and discards principles corroborated by only one source. The merged principles are written in a concise style with "Examples of" and "Counterexamples" lists drawn from the source material. We applied `WG21_MERGE` to the five knowledge files, producing [merged.know.md](https://github.com/cppalliance/wg21-sage/blob/master/knowledge/merged.know.md) containing 11 merged principles.
519
519
520
-
**Stage 3 - Judge.**[WG21_JUDGE.md](https://github.com/cppalliance/wg21-capturing-knowledge/blob/master/rules/WG21_JUDGE.md) is an evaluation model generator. Given a merged knowledge file and a focus, it produces a purpose-built scoring model for evaluating WG21 papers against the distilled principles. The generated model includes a gate function (to reject papers outside scope), scoring criteria with concrete indicators at each level (0/1/2), a passing threshold, and source traceability back to the original principles. We applied `WG21_JUDGE` to `merged.know.md` with a general focus, producing [WG21_EVAL_GENERAL.md](https://github.com/cppalliance/wg21-capturing-knowledge/blob/master/rules/WG21_EVAL_GENERAL.md) - a general-purpose evaluation model with 11 scoring criteria and a passing threshold of 14/22. The full model is reproduced in Appendix A.
520
+
**Stage 3 - Judge.**[WG21_JUDGE.md](https://github.com/cppalliance/wg21-sage/blob/master/rules/WG21_JUDGE.md) is an evaluation model generator. Given a merged knowledge file and a focus, it produces a purpose-built scoring model for evaluating WG21 papers against the distilled principles. The generated model includes a gate function (to reject papers outside scope), scoring criteria with concrete indicators at each level (0/1/2), a passing threshold, and source traceability back to the original principles. We applied `WG21_JUDGE` to `merged.know.md` with a general focus, producing [WG21_EVAL_GENERAL.md](https://github.com/cppalliance/wg21-sage/blob/master/rules/WG21_EVAL_GENERAL.md) - a general-purpose evaluation model with 11 scoring criteria and a passing threshold of 14/22. The full model is reproduced in Appendix A.
|[`WG21_CAPTURE.md`](https://github.com/cppalliance/wg21-capturing-knowledge/blob/master/rules/WG21_CAPTURE.md)| Interview transcript |`*.know.md`| Extract principles and experiences from a single source |
527
-
|[`WG21_MERGE.md`](https://github.com/cppalliance/wg21-capturing-knowledge/blob/master/rules/WG21_MERGE.md)| Multiple `*.know.md` files |`merged.know.md`| Retain only principles corroborated by 2+ independent sources |
528
-
|[`WG21_JUDGE.md`](https://github.com/cppalliance/wg21-capturing-knowledge/blob/master/rules/WG21_JUDGE.md)|`merged.know.md` + focus |`WG21_EVAL_*.md`| Generate a paper-scoring model from merged principles |
526
+
|[`WG21_CAPTURE.md`](https://github.com/cppalliance/wg21-sage/blob/master/rules/WG21_CAPTURE.md)| Interview transcript |`*.know.md`| Extract principles and experiences from a single source |
527
+
|[`WG21_MERGE.md`](https://github.com/cppalliance/wg21-sage/blob/master/rules/WG21_MERGE.md)| Multiple `*.know.md` files |`merged.know.md`| Retain only principles corroborated by 2+ independent sources |
528
+
|[`WG21_JUDGE.md`](https://github.com/cppalliance/wg21-sage/blob/master/rules/WG21_JUDGE.md)|`merged.know.md` + focus |`WG21_EVAL_*.md`| Generate a paper-scoring model from merged principles |
529
529
530
530
---
531
531
532
532
## 6. Application: Self-Evaluation
533
533
534
-
To demonstrate the evaluation model in practice, the lead author applied `WG21_EVAL_GENERAL.md` (Appendix A) to his own paper [P4003R0](https://wg21.link/p4003r0) "Coroutines for I/O". The result is [d4003-eval.md](https://github.com/cppalliance/wg21-capturing-knowledge/blob/master/evaluations/d4003-eval.md), reproduced in full in Appendix B.
534
+
To demonstrate the evaluation model in practice, the lead author applied `WG21_EVAL_GENERAL.md` (Appendix A) to his own paper [P4003R0](https://wg21.link/p4003r0) "Coroutines for I/O". The result is [d4003-eval.md](https://github.com/cppalliance/wg21-sage/blob/master/evaluations/d4003-eval.md), reproduced in full in Appendix B.
535
535
536
536
The paper scored **17/22** (passing threshold: 14/22). Six criteria received full marks: complexity awareness, implementation validation, external incubation, knowledge capture, enabling previously-impossible capabilities, and principled design. Five criteria scored partial: political fragility, proven practice (limited independent adoption), consensus collaboration (single-organization development), language-library boundary tensions, and licensing documentation.
0 commit comments