Skip to content

feat(brain): add provisional continuous visual navigation - #759

Draft
axelpey wants to merge 5 commits into
codex/webapp-onboarding-tourfrom
codex/local-continuous-navigation
Draft

feat(brain): add provisional continuous visual navigation#759
axelpey wants to merge 5 commits into
codex/webapp-onboarding-tourfrom
codex/local-continuous-navigation

Conversation

@axelpey

@axelpey axelpey commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

Summary

  • keep nav_insight_continuous(target_description) as a built-in mode in the new local-agent loop
  • add innate-os/continuous_navigation as a separately launchable, long-running skill with its own camera and Gemini decision loop
  • reassess fresh camera frames while Nav2 is still moving; keep an unchanged waypoint without restarting the base, or cancel and replace an in-flight waypoint when the visual route changes
  • ground model-selected floor pixels into stable odom-frame goals so model and cancellation latency do not stale the next command
  • stop active motion on reached, blocked, user cancel, deactivation, navigation failure, or external interruption

Two implementations

  1. Local agent mode: the agent retains the objective and supervises bounded go_to_point_in_view -> navigate_to_position actions from its normal turn loop.
  2. Standalone skill: continuous_navigation owns the full loop inside one skill run and can be launched directly from the skill surface.

Both use Nav2 for path planning and obstacle avoidance. Neither changes the configured drive-speed limits. Replans are only issued for a materially different visual goal so repeated reassessment does not continually reset acceleration.

Verification

  • focused local-brain plus standalone-skill tests: 67 passed
  • standalone skill appears live as innate-os/continuous_navigation with no load error
  • live Low Poly Town run: initial decision, in-motion reassessment, objective reached at the traffic lights
  • ruff check and ruff format --check on all affected files
  • git diff --check

This remains a draft because the standalone visual policy is intentionally a direct local port and still needs physical-robot validation.

@axelpey
axelpey force-pushed the codex/local-continuous-navigation branch from c4218b0 to 125e44b Compare September 4, 2026 18:53
@axelpey
axelpey changed the base branch from main to codex/webapp-onboarding-tour September 4, 2026 18:53
@axelpey
axelpey force-pushed the codex/local-continuous-navigation branch 4 times, most recently from d339893 to a377c88 Compare September 4, 2026 20:39
@axelpey
axelpey force-pushed the codex/webapp-onboarding-tour branch from cf602ee to 0f2ec90 Compare September 4, 2026 22:01
@axelpey
axelpey force-pushed the codex/local-continuous-navigation branch 2 times, most recently from ae06469 to a37a880 Compare September 4, 2026 22:17
@axelpey
axelpey force-pushed the codex/webapp-onboarding-tour branch from 0f2ec90 to 50e995a Compare September 4, 2026 22:17
@axelpey
axelpey force-pushed the codex/local-continuous-navigation branch from a37a880 to c29bd2c Compare September 4, 2026 22:33
@axelpey
axelpey force-pushed the codex/webapp-onboarding-tour branch from 50e995a to 985ea77 Compare September 4, 2026 22:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant