Skip to content

Commit 6e7cf9b

Browse files
authored
Revise README for clarity and add illustrations
Updated README to enhance clarity and structure. Added illustrations and refined progress section.
1 parent cbf1724 commit 6e7cf9b

1 file changed

Lines changed: 29 additions & 7 deletions

File tree

  • PW45_2026_Boston/Projects/AiDrivenInterfaceForSlicertms

PW45_2026_Boston/Projects/AiDrivenInterfaceForSlicertms/README.md

Lines changed: 29 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -59,7 +59,7 @@ SlicerTMS is a 3DSlicer module for patient-specific transcranial stimulation. It
5959

6060

6161

62-
## Progress
62+
## Progress and Illustrations
6363

6464
- SlicerTMS Navigation workflow automated by integrating Local LLM.
6565
- SlicerTMS Registration feature is controlled by cookbook: RAG router bypassing LLM logic for known tasks. Near zero-latency for defined commands.
@@ -83,19 +83,18 @@ Concept: Direct route bypasses LLM logic for safe, immediate execution.
8383
┃ ↓
8484
┃ ( Safe Medical API Execution )
8585
```
86-
Cookbook Matching </br>
86+
Cookbook Matching
8787
<img src="./Cookbook matching.png" width="400" alt="Description">
8888

8989
Surface Registration
9090
<img src="./surface registration.png" width="700" alt="Description"> </br>
9191

92-
93-
9492
## Next Steps
9593

9694
- AI Agent must understand scenes and coordinates before reasoning (Spatial understanding).
9795
- AI agent should execute active Read-Reason-Action loops. System should auto-correct spatial errors like "F10 is 2mm off".
9896
- Local LLMs must be evaluated against cloud models like Claude: accuracy vs execution speed for targeting tasks.
97+
9998
```text
10099
[ PHASE 2: FUTURE WORK ] Active Scene Introspection & Reasoning Loop
101100
=========================================================================
@@ -114,14 +113,37 @@ Concept: LLM acts as a "Tool User" with bi-directional spatial awareness.
114113
3. REASON ➔ Calculate Offset (Z: 55.0 - 2.0 = 53.0)
115114
4. ACTION ➔ Triggers Cookbook: MoveNode("F10", [0,0,-2])
116115
```
117-
118116
Active AI Agent </br>
119117
<img src="./future_1.png" width="700" alt="Description"> </br>
120118

121119

122-
# Illustrations
120+
## Next Steps
121+
122+
- AI Agent must understand scenes and coordinates before reasoning (Spatial understanding).
123+
- AI agent should execute active Read-Reason-Action loops. System should auto-correct spatial errors like "F10 is 2mm off".
124+
- Local LLMs must be evaluated against cloud models like Claude: accuracy vs execution speed for targeting tasks.
125+
126+
```text
127+
=========================================================================
128+
[ PHASE 2: FUTURE WORK ] Active Scene Introspection & Reasoning Loop
129+
=========================================================================
130+
Concept: LLM acts as a "Tool User" with bi-directional spatial awareness.
123131
124-
<!-- Add pictures and links to videos that demonstrate what has been accomplished. -->
132+
[ Surgeon Input ] ➔ ( e.g., "F10 is off by 2mm, move it down" )
133+
134+
[ RAG Router ] ━━━ ( Semantic Similarity Calculation )
135+
136+
┗━━━ [ Match < 0.35 ] ➔ [ LLM Deep Reasoning ]
137+
138+
[ Bi-Directional Query Loop ]
139+
140+
1. READ ➔ Calls GetNodeCoordinate("F10")
141+
2. RETURN ⬅ Slicer: {"F10": [x:45.2, y:12.1, z:55.0]}
142+
3. REASON ➔ Calculate Offset (Z: 55.0 - 2.0 = 53.0)
143+
4. ACTION ➔ Triggers Cookbook: MoveNode("F10", [0,0,-2])
144+
```
145+
Active AI Agent
146+
<img src="./future_1.png" width="700" alt="Description"> </br>
125147

126148

127149
_No response_

0 commit comments

Comments
 (0)