Skip to content

fix(vscuse): Auto-fix DA_With_EK_Happy_Path (progress 73→87 steps, not a plan issue) - #16397

Open
xiaolang124 wants to merge 1 commit into
devfrom
auto-fix/DA_With_EK_Happy_Path/2026-07-21
Open

fix(vscuse): Auto-fix DA_With_EK_Happy_Path (progress 73→87 steps, not a plan issue)#16397
xiaolang124 wants to merge 1 commit into
devfrom
auto-fix/DA_With_EK_Happy_Path/2026-07-21

Conversation

@xiaolang124

Copy link
Copy Markdown
Contributor

VscUse Auto-Fix Results

Plan: DA_With_EK_Happy_Path
Status: 🔍 NOT A PLAN ISSUE (AI diagnosis after 2 attempt(s))
Initial Report: Link
Final Report: Link

Iteration Summary

# Fix Applied Result Report
1 In group group__debug_in_copilot_remote_DA_no_action_Copilot_License.json, fixed ❌ Failed Report
2 NOT_PLAN_ISSUE: The Preview-in-Copilot OAuth login redirected to the /common/ 🔍 Not a plan issue

AI Diagnosis

🔍 This failure is NOT caused by the test plan. The AI identified an external issue:

The Preview-in-Copilot OAuth login redirected to the /common/ endpoint instead of /organizations/, dropping the declarative-agent deep-link, so generic M365 Copilot (not the provisioned DA) answered and refused the GPA query; the login-mechanics fix was already applied in attempt 1, and the endpoint/agent-loading behavior is controlled by the extension's launch URL, not by plan step edits.

👉 Action needed: Investigate the root cause above. No plan changes will fix this.

How to Review

  • Each commit represents one fix attempt for plans/DA_With_EK_Happy_Path.json
  • Compare the initial report with the final report to verify the fix
  • Check that coordinate/dhash changes are reasonable for the current VS Code layout

Changes Made to Test Plan

.../vscuse/vscode-test-cases/plans/DA_With_EK_Happy_Path.json  | 10 +++++-----
 1 file changed, 5 insertions(+), 5 deletions(-)
View diff
diff --git a/packages/tests/vscuse/vscode-test-cases/plans/DA_With_EK_Happy_Path.json b/packages/tests/vscuse/vscode-test-cases/plans/DA_With_EK_Happy_Path.json
index 20f0a79..ccf5a08 100644
--- a/packages/tests/vscuse/vscode-test-cases/plans/DA_With_EK_Happy_Path.json
+++ b/packages/tests/vscuse/vscode-test-cases/plans/DA_With_EK_Happy_Path.json
@@ -69,7 +69,7 @@
         "x": 354,
         "y": 88
       },
-      "description": "Select the \"Declarative Agent – Agents for Microsoft 365 Copilot\" option in the \"New Project\" dropdown within Visual Studio Code.",
+      "description": "Select the \"Declarative Agent \u2013 Agents for Microsoft 365 Copilot\" option in the \"New Project\" dropdown within Visual Studio Code.",
       "content_refs": [],
       "timeout": 30,
       "retry_count": 0,
@@ -153,7 +153,7 @@
       "agent": "code",
       "tool": "",
       "parameters": {
-        "sample": "=== Generated Script ===\nLanguage: bash\n\n```bash\n#!/bin/bash\n\nTARGET_DIR=\"/home/vscode/AgentsToolkitProjects/vscuse_app_XfRJT\"\nFILE_URL=\"https://raw.githubusercontent.com/ayachensiyuan/vscuse-resources/refs/heads/main/DA-EK/Document.docx\"\nFILE_NAME=\"Document.docx\"\n\n# Create target directory if it doesn't exist\nmkdir -p \"$TARGET_DIR\"\n\n# Download file with timeout\ncurl -L --max-time 120 \"$FILE_URL\" -o \"$TARGET_DIR/$FILE_NAME\"\n```\n\n=== Execution Results ===\nExit Code: 0\n\n=== STDERR ===\n% Total    % Received % Xferd  Average Speed   Time    Time     Time  Current\n                                 Dload  Upload   Total   Spent    Left  Speed\n\n  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0\n 11  695k   11 81911    0     0   138k      0  0:00:05 --:--:--  0:00:05  137k\n100  695k  100  695k    0     0   612k      0  0:00:01  0:00:01 --:--:--  612k\n\n✓ Script executed successfully"
+        "sample": "=== Generated Script ===\nLanguage: bash\n\n```bash\n#!/bin/bash\n\nTARGET_DIR=\"/home/vscode/AgentsToolkitProjects/vscuse_app_XfRJT\"\nFILE_URL=\"https://raw.githubusercontent.com/ayachensiyuan/vscuse-resources/refs/heads/main/DA-EK/Document.docx\"\nFILE_NAME=\"Document.docx\"\n\n# Create target directory if it doesn't exist\nmkdir -p \"$TARGET_DIR\"\n\n# Download file with timeout\ncurl -L --max-time 120 \"$FILE_URL\" -o \"$TARGET_DIR/$FILE_NAME\"\n```\n\n=== Execution Results ===\nExit Code: 0\n\n=== STDERR ===\n% Total    % Received % Xferd  Average Speed   Time    Time     Time  Current\n                                 Dload  Upload   Total   Spent    Left  Speed\n\n  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0\n 11  695k   11 81911    0     0   138k      0  0:00:05 --:--:--  0:00:05  137k\n100  695k  100  695k    0     0   612k      0  0:00:01  0:00:01 --:--:--  612k\n\n\u2713 Script executed successfully"
       },
       "description": "@code download file: https://raw.githubusercontent.com/ayachensiyuan/vscuse-resources/refs/heads/main/DA-EK/Document
... (truncated, see commit diff for full changes)

Generated by vscuse-auto-fix.yml | model: claude-opus-4.8

…o_action_Copilot_License.json, fixed the failing login step step_a5893dc9 — login now goes to the /common/ endpoint showing the email input directly (no account picker/plus icon), so removed the two stale plus-icon dhash preconditions and updated the description to click the email input field (matching the working sibling group; coordinates 455,351 already correct).
@github-actions

github-actions Bot commented Jul 21, 2026

Copy link
Copy Markdown
Contributor

❌ VscUse Test Plan — Tests failure

Why these tests: Selected 1 impacted test plan(s) changed in this PR (no product code modified).

Branch diff: auto-fix/DA_With_EK_Happy_Path/2026-07-21dev

Results: ✅ 0 passed · ❌ 1 failed (of 1 plans)

Plans run:

  • DA_With_EK_Happy_Path

Step Status
1️⃣ Build VSIX (CD) ✅ Done
2️⃣ Build Docker image ✅ Done
3️⃣ Run UI tests ❌ Tests failure (0/1 passed)

🎯 Actual UI test run
🔗 Full pipeline results
📊 Detailed test report

ℹ️ How were these tests selected?

GitHub Copilot (Claude Sonnet 4.6, high reasoning) analysed the PR title, description, and the diff between
auto-fix/DA_With_EK_Happy_Path/2026-07-21 and dev
to pick the most relevant test plans from packages/tests/vscuse/Index.md.

@github-actions

github-actions Bot commented Jul 21, 2026

Copy link
Copy Markdown
Contributor

E2E Test Selection — AI Selected

Why these tests: All changed files are under packages/tests/vscuse/, which maps to empty array per rule 8 as these are vscuse UI tests, not e2e tests.

Cases selected (0):


View pipeline run

Need to run more tests?

Comment on this PR:

  • /e2e-run ./path/to/test.tests.ts — add specific cases to AI selection
  • /e2e-run-all — run all e2e cases

Then re-run the workflow.

@codecov

codecov Bot commented Jul 21, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 87.70%. Comparing base (ce754c5) to head (71332a1).

Additional details and impacted files

Impacted file tree graph

@@           Coverage Diff           @@
##              dev   #16397   +/-   ##
=======================================
  Coverage   87.70%   87.70%           
=======================================
  Files         645      645           
  Lines       33860    33860           
  Branches     7959     7959           
=======================================
  Hits        29697    29697           
  Misses       2356     2356           
  Partials     1807     1807           
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant