You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: skills/cuopt-multi-objective-exploration/skill-card.md
+13-13Lines changed: 13 additions & 13 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -7,16 +7,16 @@ This skill is ready for commercial/non-commercial use. <br>
7
7
NVIDIA <br>
8
8
9
9
### License/Terms of Use: <br>
10
-
Apache2.0 <br>
10
+
Apache-2.0 <br>
11
11
## Use Case: <br>
12
-
Developers and engineers exploring tradeoffs between competing objectives in optimization problems, tracing Pareto frontiers to make informed multi-objective decisions rather than accepting a single implicit weighting. <br>
12
+
Developers and engineers exploring tradeoffs between competing objectives in optimization problems, using cuOpt to trace the Pareto frontier and interpret exchange rates rather than collapsing to a single weighted answer. <br>
13
13
14
14
### Deployment Geography for Use: <br>
15
15
Global <br>
16
16
17
17
## Requirements / Dependencies: <br>
18
-
**Requires API Key or External Credential:**[No] <br>
19
-
**Credential Type(s):**[None] <br>
18
+
**Requires API Key or External Credential:**[Not Specified] <br>
19
+
**Credential Type(s):**[None identified] <br>
20
20
21
21
Do not include secrets in prompts/logs/output; use least-privilege credentials; rotate keys as appropriate. <br>
22
22
@@ -26,23 +26,23 @@ Mitigation: Review and scan skill before deployment. <br>
26
26
27
27
## Reference(s): <br>
28
28
-[cuOpt User Guide](https://docs.nvidia.com/cuopt/user-guide/latest/introduction.html) <br>
Copy file name to clipboardExpand all lines: skills/cuopt-routing-api-python/BENCHMARK.md
+13-32Lines changed: 13 additions & 32 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -7,13 +7,13 @@ This benchmark summarizes 3-Tier Evaluation from NVSkills-Eval results for the s
7
7
## Evaluation Summary
8
8
9
9
- Skill: `cuopt-routing-api-python`
10
-
- Evaluation date: 2026-05-29
10
+
- Evaluation date: 2026-06-29
11
11
- NVSkills-Eval profile: `external`
12
-
- Environment: `local`
12
+
- Environment: `astra-sandbox`
13
13
- Dataset: 1 evaluation tasks
14
-
- Attempts per task: 2
14
+
- Attempts per task: 1
15
15
- Pass threshold: 50%
16
-
- Overall verdict: FAIL
16
+
- Overall verdict: PASS
17
17
18
18
## Agents Used
19
19
@@ -54,46 +54,27 @@ Task composition is derived from the evaluation dataset when possible. Entries w
54
54
55
55
| Dimension | Num |`claude-code`|`codex`|
56
56
|---|---:|---:|---:|
57
-
| Security |2| 100% (+0%) | 100% (+0%) |
58
-
| Correctness |2| 100% (+0%) |95% (+3%) |
59
-
| Discoverability |2| 100% (+0%) |70% (-5%) |
60
-
| Effectiveness |2|83% (+14%) |83% (+12%) |
61
-
| Efficiency |2|93% (-0%) |56% (-5%) |
57
+
| Security |1| 100% (+0%) | 100% (+0%) |
58
+
| Correctness |1| 100% (+70%) |97% (+42%) |
59
+
| Discoverability |1| 100% (+100%) |82% (+57%) |
60
+
| Effectiveness |1|82% (+45%) |74% (+29%) |
61
+
| Efficiency |1|95% (+67%) |72% (+45%) |
62
62
63
63
Score values show skill-assisted performance. Values in parentheses show uplift versus the no-skill baseline when baseline data is available.
64
64
65
65
## Tier 1: Static Validation Summary
66
66
67
-
Tier 1 validation passed with observations. NVSkills-Eval ran 9 checks and found 8 total findings.
67
+
Tier 1 validation passed with observations. NVSkills-Eval ran 1 checks and found 2 total findings.
68
68
69
69
Top findings:
70
70
71
71
- MEDIUM SCHEMA/body_recommended_section: Missing recommended section: '## Instructions' (`skills/cuopt-routing-api-python/SKILL.md`)
72
-
- MEDIUM SECURITY/Unknown (SQP-2): Binding the cuOpt server to 0.0.0.0 exposes it on all network interfaces, making it accessible to any host that can reac (`references/server_examples.md:7`)
73
-
- LOW QUALITY/quality_discoverability: No '## Purpose' section (`skills/cuopt-routing-api-python/SKILL.md`)
74
-
- LOW QUALITY/quality_reliability: No prerequisites/requirements documented (`skills/cuopt-routing-api-python/SKILL.md`)
75
-
- LOW QUALITY/quality_reliability: No limitations documented (`skills/cuopt-routing-api-python/SKILL.md`)
72
+
- LOW SCHEMA/author_format: Author must be of the form 'Name <email@host>' (`skills/cuopt-routing-api-python/SKILL.md`)
76
73
77
74
## Tier 2: Deduplication Summary
78
75
79
-
Tier 2 validation reported findings. NVSkills-Eval ran 2 checks and found 4 total findings.
80
-
81
-
Top findings:
82
-
83
-
- HIGH DUPLICATE/duplicate: Duplicate content found within references/server_examples.md:
84
-
"# Poll for solution" in references/server_examples.md (lines 45-51)
85
-
vs "# Poll for solution" in references/server_examples.md (lines 156-162) (`references/server_examples.md:45`)
86
-
- HIGH DUPLICATE/duplicate: Duplicate content found across SKILL.md and references/examples.md:
87
-
"# Capacities" in SKILL.md (lines 30-35)
88
-
vs "# Add capacity dimension (name, demand_per_order, capacity_per_vehicle)" in references/examples.md (lines 73-75)
89
-
vs "# Add capacity dimension" in references/examples.md (lines 156-158) (`SKILL.md:30`)
90
-
- HIGH DUPLICATE/duplicate: Duplicate content found across references/examples.md and references/server_examples.md:
91
-
"## Additional References (tested in CI)" in references/examples.md (lines 237-249)
92
-
vs "## Additional References (tested in CI)" in references/server_examples.md (lines 193-204) (`references/examples.md:237`)
93
-
- HIGH DUPLICATE/duplicate: Duplicate content found across assets/pdp_basic/README.md and assets/pdp_basic/model.py:
94
-
"# Pickup-Delivery (PDP)" in assets/pdp_basic/README.md (lines 1-7)
95
-
vs "(module docstring)" in assets/pdp_basic/model.py (lines 1-2) (`assets/pdp_basic/README.md:1`)
76
+
This tier was not run or did not produce findings in this report.
96
77
97
78
## Publication Recommendation
98
79
99
-
The skill should be reviewed before NVSkills-Eval publication. Skill owners should address the findings above and rerun NVSkills-Eval to refresh this benchmark.
80
+
The skill is suitable to proceed toward NVSkills-Eval publication based on this benchmark. Skill owners should keep this file with the skill and refresh it when the evaluation dataset, skill behavior, or target agents materially change.
0 commit comments