Skip to content

Bug: Most Agent tests pass even if no agents are deployed #1602

@api-Hypernova

Description

@api-Hypernova

Describe the bug

Discovered during initial V4 testing:

Test Suite: agents-text
Environment: dev
API URL: https://grpc.testnet-staging.xmtp.network:443
Configuration: Simple run (direct execution)

 RUN  v3.2.4 /home/ubuntu/eph/xmtp-qa-tools
      API started at http://localhost:51204/

stdout | agents/monitoring/agents-text.test.ts
[SDK 1.6.1] Using D14N mode with gateway: https://grpc.testnet-staging.xmtp.network:443

2025-11-20 20:24:09.487: WARN CORE sqlcipherCodecAttach: no codec attached to db
�[2m2025-11-20T20:24:09.541138Z�[0m �[33m WARN�[0m �[2mxmtp_mls::utils::events�[0m�[2m:�[0m Unable to send event to writing worker: SendError(Events { created_at_ns: 1763670249541117925, group_id: None, event: "Client Build", details: Null, level: None, icon: None })
stdout | agents/monitoring/agents-text.test.ts
[
  "dev:randomguy-a 0x8DBFDc9D009eB4F0E3E7a23d2cbE8c223C80D462 1.6.1 1 - 1.00 B"
]

stdout | agents/monitoring/agents-text.test.ts > agents-text
[2025-11-20T20:24:09.590Z] [�[33mwarn�[39m] ⚠️ DATADOG_API_KEY not found - metrics will not be sent

stdout | agents/monitoring/agents-text.test.ts > agents-text > agents-text: No agents configured for this environment
[2025-11-20T20:24:09.592Z] [�[32minfo�[39m] No agents found for env: dev

stdout | agents/monitoring/agents-text.test.ts > agents-text > agents-text: No agents configured for this environment
[2025-11-20T20:24:09.593Z] [�[32minfo�[39m] agents-text > agents-text: No agents configured for this environment

 ✓ agents/monitoring/agents-text.test.ts (1 test) 17ms

 Test Files  1 passed (1)
      Tests  1 passed (1)
   Start at  20:24:08
   Duration  1.52s (transform 226ms, setup 0ms, collect 1.29s, tests 17ms, environment 0ms, prepare 76ms)

Expected behavior

The tests should fail if there are no agents.
This is happening for:

agents-text
agents-tagged
agents-untagged
agents-stress

agents-dms properly fails if no agents are deployed

Steps to reproduce the bug

Run any of these agent tests against any D14N environment:

agents-text
agents-tagged
agents-untagged
agents-stress

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    Projects

    Status

    Later

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions