|
1 | 1 | # THE SILMARIL STRIKES AGAIN: building better AI systems with deterministic reasoning capabilities using Ontologies |
2 | 2 |
|
3 | 3 |
|
4 | | -# Abstract |
5 | | - |
6 | | -Large language models now power many agentic systems. |
7 | | -Common interaction patterns include: |
| 4 | +# Abstract |
| 5 | + |
| 6 | +Large language models now power many agentic systems. |
| 7 | +Common interaction patterns include: |
8 | 8 | * plan first, then execute [@wang2023plansolve] |
9 | 9 | * reason and act in turns, as in ReAct [@yao2023react] |
10 | 10 | * reflect on feedback and try again, as in Reflexion [@shinn2023reflexion] |
11 | 11 | * call external tools and APIs [@schick2023toolformer] |
12 | 12 | * ...and more |
13 | | -These patterns make language models more useful as agents. |
| 13 | +These patterns make language models more useful as agents. |
14 | 14 | But the agent is still largely driven by model-generated state, reasoning, and decisions. |
15 | 15 | That creates four pressures: |
16 | 16 | * **Grounding:** the system needs stable identities for entities and typed relations between them. |
17 | 17 | * **Multi-hop reasoning:** the system may need conclusions that follow through several relations or rules. |
18 | 18 | * **Coordination:** several agents or tools need a shared meaning for entities, classes, properties, and constraints. |
19 | | -* **Verification and audit:** important decisions need a result that can be checked, replayed, and linked to the facts and rules that produced it. |
| 19 | +* **Verification and audit:** important decisions need a result that can be checked, replayed, and linked to the facts and rules that produced it. |
20 | 20 | These are areas where language-model generation alone does not provide formal guarantees. Entity tracking varies across models and task complexity [@kim2023entitytracking]. Multi-hop reasoning can fail or follow plausible but incorrect paths [@yang2024latentmultihop; @bhuiya2024multihop]. Generated chain-of-thought is not necessarily a faithful account of how an answer was produced [@lanham2023faithfulness]. Model responses can also move toward a user's stated views in tested settings [@sharma2023sycophancy]. |
21 | | -Ontologies and reasoning engines provide a different layer. Ontologies represent selected entities, classes, properties, and axioms under explicit semantics [@w3c2012owl2overview]. Reasoners can then derive conclusions, answer queries, check consistency, test constraints, and record justifications under defined procedures. |
22 | | -This paper starts with the Closed World Machine (CWM) as a historical Python reasoner. It then explains forward and backward reasoning, RETE, truth maintenance, description-logic reasoning, stratified negation, resolution, Satisfiability Modulo Theories, and the chase. |
| 21 | +Ontologies and reasoning engines provide a different layer. Ontologies represent selected entities, classes, properties, and axioms under explicit semantics [@w3c2012owl2overview]. Reasoners can then derive conclusions, answer queries, check consistency, test constraints, and record justifications under defined procedures. |
| 22 | +This paper starts with the Closed World Machine (CWM) as a historical Python reasoner. It then explains forward and backward reasoning, RETE, truth maintenance, description-logic reasoning, stratified negation, resolution, Satisfiability Modulo Theories, and the chase. |
23 | 23 |
|
24 | 24 | The paper then shows how these methods can be composed inside a **propose-check-repair** loop for agentic systems: |
25 | 25 | * the language model **proposes** |
26 | 26 | * one or more reasoners **check** |
27 | 27 | * failed checks return structured evidence |
28 | 28 | * the model **repairs** the proposal |
29 | 29 | * accepted results can move to a separate action policy |
30 | | -The language model remains the flexible generative component. The ontology and reasoning layer provides formal checks that language generation alone does not guarantee. |
| 30 | +The language model remains the flexible generative component. The ontology and reasoning layer provides formal checks that language generation alone does not guarantee. |
31 | 31 | The paper finally discusses columnar, distributed, and GPU execution as possible ways to scale selected reasoning workloads. It does not present a completed production reasoner or new performance results. |
32 | 32 |
|
33 | 33 | --- |
|
0 commit comments