Skip to content

feat: add Ollama agent with LlamaIndex and dynamic tool loading#4

Draft
abhijeet-dhumal wants to merge 1 commit intokubeflow:mainfrom
abhijeet-dhumal:feat/ollama-agent
Draft

feat: add Ollama agent with LlamaIndex and dynamic tool loading#4
abhijeet-dhumal wants to merge 1 commit intokubeflow:mainfrom
abhijeet-dhumal:feat/ollama-agent

Conversation

@abhijeet-dhumal
Copy link
Copy Markdown
Member

@abhijeet-dhumal abhijeet-dhumal commented Apr 9, 2026

Depends and blocked by : #1, #2 and #3 resp.

Adds a local AI agent that drives the MCP server using Ollama-hosted models, with token-efficient tool discovery to avoid context overflow.

What's included:

  • LlamaIndex FunctionAgent wired to the MCP server via Ollama LLM backend
  • Two tool discovery modes selectable at startup:
    • Progressive — hierarchical phase-based lookup, loads only relevant tool schemas on demand
    • Semantic — embedding similarity search, finds tools by meaning without loading all schemas
  • CLI entry point: kubeflow-mcp agent --model qwen3:8b --mode progressive

Signed-off-by: abhijeet-dhumal <abhijeetdhumal652@gmail.com>
@google-oss-prow
Copy link
Copy Markdown

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please ask for approval from abhijeet-dhumal. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant