@@ -59,7 +59,7 @@ SlicerTMS is a 3DSlicer module for patient-specific transcranial stimulation. It
5959
6060
6161
62- ## Progress
62+ ## Progress and Illustrations
6363
6464- SlicerTMS Navigation workflow automated by integrating Local LLM.
6565- SlicerTMS Registration feature is controlled by cookbook: RAG router bypassing LLM logic for known tasks. Near zero-latency for defined commands.
@@ -83,19 +83,18 @@ Concept: Direct route bypasses LLM logic for safe, immediate execution.
8383 ┃ ↓
8484 ┃ ( Safe Medical API Execution )
8585```
86- Cookbook Matching </ br >
86+ Cookbook Matching
8787<img src =" ./Cookbook matching.png " width =" 400 " alt =" Description " >
8888
8989Surface Registration
9090<img src =" ./surface registration.png " width =" 700 " alt =" Description " > </br >
9191
92-
93-
9492## Next Steps
9593
9694- AI Agent must understand scenes and coordinates before reasoning (Spatial understanding).
9795- AI agent should execute active Read-Reason-Action loops. System should auto-correct spatial errors like "F10 is 2mm off".
9896- Local LLMs must be evaluated against cloud models like Claude: accuracy vs execution speed for targeting tasks.
97+
9998``` text
10099[ PHASE 2: FUTURE WORK ] Active Scene Introspection & Reasoning Loop
101100=========================================================================
@@ -114,14 +113,37 @@ Concept: LLM acts as a "Tool User" with bi-directional spatial awareness.
114113 3. REASON ➔ Calculate Offset (Z: 55.0 - 2.0 = 53.0)
115114 4. ACTION ➔ Triggers Cookbook: MoveNode("F10", [0,0,-2])
116115```
117-
118116Active AI Agent </br >
119117<img src =" ./future_1.png " width =" 700 " alt =" Description " > </br >
120118
121119
122- # Illustrations
120+ ## Next Steps
121+
122+ - AI Agent must understand scenes and coordinates before reasoning (Spatial understanding).
123+ - AI agent should execute active Read-Reason-Action loops. System should auto-correct spatial errors like "F10 is 2mm off".
124+ - Local LLMs must be evaluated against cloud models like Claude: accuracy vs execution speed for targeting tasks.
125+
126+ ``` text
127+ =========================================================================
128+ [ PHASE 2: FUTURE WORK ] Active Scene Introspection & Reasoning Loop
129+ =========================================================================
130+ Concept: LLM acts as a "Tool User" with bi-directional spatial awareness.
123131
124- <!-- Add pictures and links to videos that demonstrate what has been accomplished. -->
132+ [ Surgeon Input ] ➔ ( e.g., "F10 is off by 2mm, move it down" )
133+ ↓
134+ [ RAG Router ] ━━━ ( Semantic Similarity Calculation )
135+ ↓
136+ ┗━━━ [ Match < 0.35 ] ➔ [ LLM Deep Reasoning ]
137+ ↓
138+ [ Bi-Directional Query Loop ]
139+ ↓
140+ 1. READ ➔ Calls GetNodeCoordinate("F10")
141+ 2. RETURN ⬅ Slicer: {"F10": [x:45.2, y:12.1, z:55.0]}
142+ 3. REASON ➔ Calculate Offset (Z: 55.0 - 2.0 = 53.0)
143+ 4. ACTION ➔ Triggers Cookbook: MoveNode("F10", [0,0,-2])
144+ ```
145+ Active AI Agent
146+ <img src =" ./future_1.png " width =" 700 " alt =" Description " > </br >
125147
126148
127149_ No response_
0 commit comments