Skip to content
CI

feat(dsh): add shared Harness analysis #331

Sign in to view logs

feat(dsh): add shared Harness analysis

feat(dsh): add shared Harness analysis #331

Triggered via pull request August 24, 2026 09:49
@Cobb04Cobb04
opened #110
Cobb04:feat/dsh-shared-harness-analysis
Status Failure
Total duration 3m 55s
Artifacts 4

ci.yml

on: pull_request
Matrix: test
Fit to window
Zoom out
Zoom in

Annotations

10 errors
test/agents/coding-agent-practices-inventory.test.mjs > direct provider inventory canonicalizes configured cwd before using injected evidence: test/agents/coding-agent-practices-inventory.test.mjs#L685
AssertionError: Expected values to be strictly equal: + actual - expected + 'C:\\Users\\RUNNER~1\\AppData\\Local\\Temp\\better-harness-provider-cwd-CHjb3Y\\workspace' - 'C:\\Users\\runneradmin\\AppData\\Local\\Temp\\better-harness-provider-cwd-CHjb3Y\\workspace' Expected: "C:\Users\runneradmin\AppData\Local\Temp\better-harness-provider-cwd-CHjb3Y\workspace" Received: "C:\Users\RUNNER~1\AppData\Local\Temp\better-harness-provider-cwd-CHjb3Y\workspace" ❯ test/agents/coding-agent-practices-inventory.test.mjs:685:12
test/agents/coding-agent-practices-inventory.test.mjs > shared provider inventory emits deterministic Skills and Rules practice coverage: test/agents/coding-agent-practices-inventory.test.mjs#L627
AssertionError: Expected values to be strictly deep-equal: + actual - expected ... Skipped lines [ { count: 1, paths: [ + '~/AppData/Local/Temp/better-harness-practice-coverage-z4DUSk/workspace/AGENTS.md' - 'AGENTS.md' ], scopes: [ 'Project' ], surface: 'Rules' ... paths: [ + '~/AppData/Local/Temp/better-harness-practice-coverage-z4DUSk/workspace/.dsh/skills/review/SKILL.md' - '.dsh/skills/review/SKILL.md' ], scopes: [ 'Project' ], surface: 'Skills' - Expected + Received @@ -1,20 +1,20 @@ [ { "count": 1, "paths": [ - "AGENTS.md", + "~/AppData/Local/Temp/better-harness-practice-coverage-z4DUSk/workspace/AGENTS.md", ], "scopes": [ "Project", ], "surface": "Rules", }, { "count": 1, "paths": [ - ".dsh/skills/review/SKILL.md", + "~/AppData/Local/Temp/better-harness-practice-coverage-z4DUSk/workspace/.dsh/skills/review/SKILL.md", ], "scopes": [ "Project", ], "surface": "Skills", ❯ test/agents/coding-agent-practices-inventory.test.mjs:627:12
test/agents/coding-agent-practices-inventory.test.mjs > Qoder inventory CLI keeps project Memory semantic scope while emitting a home-relative .md source: test/agents/coding-agent-practices-inventory.test.mjs#L409
AssertionError: Expected values to be strictly deep-equal: + actual - expected + undefined - [ - 'Project' - ] simple ❯ test/agents/coding-agent-practices-inventory.test.mjs:409:12
test/agents/coding-agent-practices-inventory.test.mjs > Qoder inventory includes current-project memories without global capability scope: test/agents/coding-agent-practices-inventory.test.mjs#L266
AssertionError: Expected values to be strictly deep-equal: + actual - expected + [] - [ - 'project_introduction' - ] - Expected + Received - [ - "project_introduction", - ] + [] ❯ test/agents/coding-agent-practices-inventory.test.mjs:266:12
test/agents/coding-agent-practices-inventory.test.mjs > Qoder global inventory separates project, user, plugin, session, and memory evidence: test/agents/coding-agent-practices-inventory.test.mjs#L151
AssertionError: Expected values to be strictly equal: + actual - expected + 'C:\\Users\\RUNNER~1\\AppData\\Local\\Temp\\better-harness-agent-assets-PKrjJk\\workspace\\demo\\check.js' - 'C:\\Users\\runneradmin\\AppData\\Local\\Temp\\better-harness-agent-assets-PKrjJk\\workspace\\demo\\check.js' Expected: "C:\Users\runneradmin\AppData\Local\Temp\better-harness-agent-assets-PKrjJk\workspace\demo\check.js" Received: "C:\Users\RUNNER~1\AppData\Local\Temp\better-harness-agent-assets-PKrjJk\workspace\demo\check.js" ❯ test/agents/coding-agent-practices-inventory.test.mjs:151:12
test/agents/agent-asset-integrity.test.mjs > public asset-integrity CLI stays read-only and omits Memory body text and private paths: test/agents/agent-asset-integrity.test.mjs#L155
AssertionError: Expected values to be strictly equal: 0 !== 2 - Expected + Received - 2 + 0 ❯ test/agents/agent-asset-integrity.test.mjs:155:12
test/agents/agent-asset-baseline.test.mjs > asset baseline compacts finding, coverage, owner, and free-text paths to stable locators: test/agents/agent-asset-baseline.test.mjs#L429
SyntaxError: Invalid regular expression: /C:\Users\RUNNER~1\AppData\Local\Temp\better-harness-baseline-locators-4LLKwb/u: Invalid escape ❯ test/agents/agent-asset-baseline.test.mjs:429:57
test/agents/agent-asset-baseline.test.mjs > asset baseline canonicalizes direct configured scope before inventory collection: test/agents/agent-asset-baseline.test.mjs#L269
AssertionError: Expected values to be strictly equal: + actual - expected + 'C:\\Users\\RUNNER~1\\AppData\\Local\\Temp\\better-harness-baseline-cwd-Q3bNni\\workspace' - 'C:\\Users\\runneradmin\\AppData\\Local\\Temp\\better-harness-baseline-cwd-Q3bNni\\workspace' Expected: "C:\Users\runneradmin\AppData\Local\Temp\better-harness-baseline-cwd-Q3bNni\workspace" Received: "C:\Users\RUNNER~1\AppData\Local\Temp\better-harness-baseline-cwd-Q3bNni\workspace" ❯ test/agents/agent-asset-baseline.test.mjs:269:12
test/agents/agent-asset-baseline.test.mjs > DeepSeek Harness baseline freezes cwd and exposes only compact configured provenance: test/agents/agent-asset-baseline.test.mjs#L219
AssertionError: Expected values to be strictly deep-equal: + actual - expected { + cwd: 'C:\\Users\\RUNNER~1\\AppData\\Local\\Temp\\better-harness-dsh-baseline-QHbB1H\\repository\\packages\\api\\src', - cwd: 'C:\\Users\\runneradmin\\AppData\\Local\\Temp\\better-harness-dsh-baseline-QHbB1H\\repository\\packages\\api\\src', includeMemories: false, includeUserHome: false, provider: 'dsh', + workspace: 'C:\\Users\\RUNNER~1\\AppData\\Local\\Temp\\better-harness-dsh-baseline-QHbB1H\\repository\\packages\\api' - workspace: 'C:\\Users\\runneradmin\\AppData\\Local\\Temp\\better-harness-dsh-baseline-QHbB1H\\repository\\packages\\api' } - Expected + Received { - "cwd": "C:\\Users\\runneradmin\\AppData\\Local\\Temp\\better-harness-dsh-baseline-QHbB1H\\repository\\packages\\api\\src", + "cwd": "C:\\Users\\RUNNER~1\\AppData\\Local\\Temp\\better-harness-dsh-baseline-QHbB1H\\repository\\packages\\api\\src", "includeMemories": false, "includeUserHome": false, "provider": "dsh", - "workspace": "C:\\Users\\runneradmin\\AppData\\Local\\Temp\\better-harness-dsh-baseline-QHbB1H\\repository\\packages\\api", + "workspace": "C:\\Users\\RUNNER~1\\AppData\\Local\\Temp\\better-harness-dsh-baseline-QHbB1H\\repository\\packages\\api", } ❯ test/agents/agent-asset-baseline.test.mjs:219:10
test/agents/agent-asset-baseline.test.mjs > asset baseline shares one inventory snapshot and emits compact AI envelopes: test/agents/agent-asset-baseline.test.mjs#L147
AssertionError: Expected values to be strictly equal: + actual - expected + 'C:\\Users\\RUNNER~1\\AppData\\Local\\Temp\\better-harness-baseline-project-mHaikX\\workspace' - 'C:\\Users\\runneradmin\\AppData\\Local\\Temp\\better-harness-baseline-project-mHaikX\\workspace' Expected: "C:\Users\runneradmin\AppData\Local\Temp\better-harness-baseline-project-mHaikX\workspace" Received: "C:\Users\RUNNER~1\AppData\Local\Temp\better-harness-baseline-project-mHaikX\workspace" ❯ test/agents/agent-asset-baseline.test.mjs:147:10

Artifacts

Produced during runtime
Name Size Digest
test-results-macos-latest-node-22.20.0
53.7 KB
sha256:aef6823297b39561a727c303c7b06d49e8ecfee14352ae9661df30bd69b2f27f
test-results-ubuntu-latest-node-22.20.0
54.9 KB
sha256:e46614d9f1ac5b52238195097ee61524a6b7e77543e3051392167d506ab7c786
test-results-ubuntu-latest-node-24.x
55 KB
sha256:ed87d9d512937ed3cd3c07bbfc8611466460c79ef90795360f717a5c5b486b5d
test-results-windows-latest-node-22.20.0
55.2 KB
sha256:876855bfe3f6a370479f10a28cc5cd7cfc6f2701efd07550e752ecd31fc8790c