Skip to content

Commit 139584d

Browse files
add issue temmplate
1 parent ac2ff6d commit 139584d

3 files changed

Lines changed: 138 additions & 0 deletions

File tree

Lines changed: 106 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,106 @@
1+
name: Bug Report
2+
description: Report a bug or unexpected behavior in agentevals
3+
labels: ["bug"]
4+
body:
5+
- type: markdown
6+
attributes:
7+
value: |
8+
Thank you for taking the time to report a bug. Please fill out the sections below so we can reproduce and fix the issue.
9+
10+
- type: textarea
11+
id: description
12+
attributes:
13+
label: Description
14+
description: What happened? Describe the bug clearly.
15+
placeholder: When I run X, Y happens instead of Z...
16+
validations:
17+
required: true
18+
19+
- type: textarea
20+
id: expected
21+
attributes:
22+
label: Expected behavior
23+
description: What did you expect to happen?
24+
validations:
25+
required: true
26+
27+
- type: textarea
28+
id: steps
29+
attributes:
30+
label: Steps to reproduce
31+
description: Minimal steps to reproduce the issue.
32+
placeholder: |
33+
1. Run `agentevals serve --dev`
34+
2. Connect an agent via WebSocket
35+
3. ...
36+
validations:
37+
required: true
38+
39+
- type: dropdown
40+
id: usage-mode
41+
attributes:
42+
label: How are you using agentevals?
43+
options:
44+
- Live streaming (WebSocket / OTLP)
45+
- CLI file evaluation (`agentevals run`)
46+
- MCP server
47+
- Other
48+
validations:
49+
required: true
50+
51+
- type: upload
52+
id: config-dump
53+
attributes:
54+
label: Config dump (ZIP from the web UI)
55+
description: |
56+
If you are using the live web UI, click the **Bug Report** button in the sidebar (the bug icon at the bottom left).
57+
This downloads a ZIP file containing your environment info, session data, and logs.
58+
Drag and drop the ZIP file here.
59+
60+
- type: textarea
61+
id: version-info
62+
attributes:
63+
label: Version information
64+
description: |
65+
If you are not using the web UI (or cannot generate the ZIP above), provide at minimum
66+
the output of `agentevals --version` and `python --version`, along with your OS name and version along with the files mentioned below.
67+
placeholder: |
68+
agentevals version: ...
69+
Python version: ...
70+
OS: ...
71+
render: text
72+
validations:
73+
required: true
74+
75+
- type: textarea
76+
id: eval-config
77+
attributes:
78+
label: Eval config (if applicable)
79+
description: |
80+
If you use an `eval_config.yaml`, paste its contents here.
81+
Please redact any secrets or API keys.
82+
render: yaml
83+
84+
- type: upload
85+
id: trace-files
86+
attributes:
87+
label: Trace and eval set files
88+
description: |
89+
If you are using the CLI (`agentevals run`) or file upload method rather than live streaming,
90+
please attach your trace file(s) and eval set file(s) so we can reproduce the issue.
91+
Supported formats: Jaeger JSON, OTLP JSON/JSONL, ADK EvalSet JSON.
92+
93+
- type: textarea
94+
id: logs
95+
attributes:
96+
label: Relevant logs or error output
97+
description: |
98+
Paste any error messages, stack traces, or log output.
99+
Run with `-vv` for verbose output (e.g. `agentevals -vv run ...` or `agentevals serve --dev -vv`).
100+
render: text
101+
102+
- type: textarea
103+
id: additional
104+
attributes:
105+
label: Additional context
106+
description: Anything else that might help (screenshots, related issues, workarounds you tried, etc.).

.github/ISSUE_TEMPLATE/config.yml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
blank_issues_enabled: false
Lines changed: 31 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,31 @@
1+
name: Feature Request
2+
description: Suggest a new feature or improvement
3+
labels: ["enhancement"]
4+
body:
5+
- type: textarea
6+
id: problem
7+
attributes:
8+
label: Problem or motivation
9+
description: What problem does this feature solve? Why is it needed?
10+
validations:
11+
required: true
12+
13+
- type: textarea
14+
id: solution
15+
attributes:
16+
label: Proposed solution
17+
description: Describe how you would like this to work.
18+
validations:
19+
required: true
20+
21+
- type: textarea
22+
id: alternatives
23+
attributes:
24+
label: Alternatives considered
25+
description: Any alternative solutions or workarounds you have considered.
26+
27+
- type: textarea
28+
id: additional
29+
attributes:
30+
label: Additional context
31+
description: Anything else (screenshots, links, examples, etc.).

0 commit comments

Comments
 (0)