feat(agent-tars): strict-typed gui agent procotol

[ulivz]

Summary

Implements strict typing system for GUI Agent tool responses with comprehensive type safety and extensibility. This addresses the architectural goals from #1292 by introducing a robust type system that uses generics to distinguish different action types.

Before

Directly exposes the return value of Operator execute, including some unused fields. If the underlying layer is changed, the upper layer may be unavailable.

{
    "id": "248a4fa4-7b88-40ea-a77a-4c1dfc6c8006",
    "type": "tool_result",
    "timestamp": 1756426147199,
    "toolCallId": "call_1756426145455_2fuev",
    "name": "browser_vision_control",
    "content": {
        "action": "click(point='<point>500 678</point>')",
        "status": "success",
        "result": {
            "startX": 640,
            "startY": 542.4,
            "startXPercent": 0.5,
            "startYPercent": 0.6779999999999999,
            "action_inputs": {
                "start_box": "[0.5,0.678]"
            }
        }
    },
    "elapsedMs": 1741
},

After

Relying on a stable data structure, not relying on the internal conversion details of the GUI Agent, the consumption from perspectives such as the Web UI is simple and stable.

    {
        "id": "2f670a16-210d-4b64-9c0e-4c038d848a02",
        "type": "tool_result",
        "timestamp": 1756454122281,
        "toolCallId": "call_1756454120546_fvc2u",
        "name": "browser_vision_control",
        "content": {
            "success": true,
            "action": "click(point='<point>645 587</point>')",
            "normalizedAction": {
                "type": "click",
                "inputs": {
                    "startX": 0.645,
                    "startY": 0.5870000000000001
                }
            }
        },
        "elapsedMs": 1732
    },

Checklist

• Added or updated necessary tests (Optional).
• Updated documentation to align with changes (Optional).
• Verified no breaking changes, or prepared solutions for any occurring breaking changes (Optional).
• My change does not involve the above items.

[netlify]

✅ Deploy Preview for agent-tars-docs ready!

Name	Link
🔨 Latest commit	2ce968a
🔍 Latest deploy log	https://app.netlify.com/projects/agent-tars-docs/deploys/68b16463959ff900084fe2f4
😎 Deploy Preview	https://deploy-preview-1295--agent-tars-docs.netlify.app
📱 Preview on mobile	Toggle QR Code... Use your smartphone camera to open QR code link.

---

To edit notification comments on pull requests, go to your Netlify project configuration.

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 14.26%. Comparing base (5a7200d) to head (2ce968a).
⚠️ Report is 13 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1295      +/-   ##
==========================================
+ Coverage   14.21%   14.26%   +0.04%     
==========================================
  Files         250      250              
  Lines        8562     8562              
  Branches     1672     1672              
==========================================
+ Hits         1217     1221       +4     
+ Misses       7170     7166       -4     
  Partials      175      175              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.