[NA] [SDK] feat: New MPC capabilities, tools, streamable-http and remote MCP support

[vincentkoc]

Summary

Uplift our MCP server to latest MCP spec and allow the use of remote MCP and various other improvements including deprecating old SSE approach and using MCP standards.

• Fixes: Support Remote MCP Servers #12 (once deployed and docs updated)
• Related: chore(release): bump opik-mcp to v2.0.0 #64 (Release will be bumped on that PR and tagged once this is merged)

Changes

• Migrate transport to Streamable HTTP only and remove deprecated SSE paths.
• Upgrade @modelcontextprotocol/sdk to 1.26.0 and align server/client behavior.
• Add robust remote API-key auth with bearer/x-api-key support and workspace token mapping.
• Keep remote auth explicitly non-OAuth and return JSON for OAuth probe/register endpoints.
• Change API-key auth failures to avoid client OAuth fallback loops (Cursor stuck).
• Add capabilities tools for server info, help, examples, metrics, and tracing guidance.
• Harden trace tools for current Opik feedback/thread APIs with compatibility fallback behavior.
• Normalize tool signatures/docstrings with shared schema constraints and clearer arg semantics.
• Expand MCP resources with static entries plus templates for projects/prompts/datasets/traces.
• Improve startup/dev UX with clear boot errors, endpoint banners, and optional access logs.
• Update README/config/API/transport docs to match new auth, toolset, and resource behavior.
• Expand automated tests for transport flow, auth, resources/templates, and tool signature guards.
• Implemented .well-known/ metdata discovery for seamless auth experience.

Validation

• Run with make build
• Test with make test
• Validated locally also with streaming HTTP using make dev

Verified local behaviour locally via Curl

Verified local behaviour locally on Cursor (mcp.json) to localhost. not all tools enabled by default

Verified local behaviour locally on Cursor (mcp.json) to localhost. with all capabilities enabled