Skip to content

Commit daff148

Browse files
authored
Doc formatting (#452)
1 parent 4f3782f commit daff148

1 file changed

Lines changed: 8 additions & 2 deletions

File tree

docs/openmathreasoning1/evaluation.md

Lines changed: 8 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -231,16 +231,22 @@ ns generate \
231231
--cluster=local \
232232
--server_type=trtllm \
233233
--server_gpus=1 \
234-
--num_random_seeds=8
234+
--num_random_seeds=64
235235
```
236236

237237
The output folder will have three folders (apart from log folders):
238+
238239
1. `comparison_instances`: This is the folder where input instances for genselect are kept.
240+
239241
2. `comparison_judgment`: Output of GenSelect judgments.
242+
240243
3. `hle` / `math`: Folder with outputs based on GenSelect's judgments. If `dataset` is not specified in the command, we create a folder with the name `math`
241244

242245
To print the metrics run:
243246

244247
```bash
245-
ns summarize_results /workspace/openmath-nemotron-1.5b-eval-cot/self_genselect_hle/hle --metric_type math --cluster local
248+
ns summarize_results \
249+
/workspace/openmath-nemotron-1.5b-eval-cot/self_genselect_hle/hle \
250+
--metric_type math \
251+
--cluster local
246252
```

0 commit comments

Comments
 (0)