Skip to content

Commit 23ee186

Browse files
committed
Doc updates
Signed-off-by: Igor Gitman <igitman@nvidia.com>
1 parent a13f973 commit 23ee186

5 files changed

Lines changed: 19 additions & 17 deletions

File tree

README.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -9,11 +9,11 @@ Here are some of the things we support.
99
- [Model evaluation](https://nvidia.github.io/NeMo-Skills/pipelines/evaluation): Evaluate your models on many popular benchmarks
1010
- Math problem solving: math, aime24, aime25, omni-math (and many more)
1111
- Formal proofs in Lean: minif2f, proofnet
12-
- Coding skills: lcb, human-eval, mbpp
12+
- Coding skills: livecodebench, human-eval, mbpp
1313
- Chat/instruction following: ifeval, arena-hard, mt-bench
1414
- General knowledge: mmlu, mmlu-pro, gpqa
1515
- Long context: ruler
16-
- [Model training](https://nvidia.github.io/NeMo-Skills/pipelines/training): Train models at speed-of-light using [NeMo-Aligner](https://github.com/NVIDIA/NeMo-Aligner/).
16+
- [Model training](https://nvidia.github.io/NeMo-Skills/pipelines/training): Train models at speed-of-light using [NeMo-Aligner](https://github.com/NVIDIA/NeMo-Aligner/), [NeMo-RL](https://github.com/NVIDIA/NeMo-RL/) or [verl](https://github.com/volcengine/verl).
1717

1818
You can find the full documentation [here](https://nvidia.github.io/NeMo-Skills/).
1919
To get started, follow this [tutorial](https://nvidia.github.io/NeMo-Skills/basics),

docs/basics/index.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -98,9 +98,9 @@ config might look like
9898
executor: local
9999
100100
containers:
101-
trtllm: igitman/nemo-skills-trtllm:0.5.0
102-
vllm: igitman/nemo-skills-vllm:0.5.3
103-
nemo: igitman/nemo-skills-nemo:0.5.3
101+
trtllm: igitman/nemo-skills-trtllm:0.6.1
102+
vllm: vllm/vllm-openai:v0.9.0
103+
nemo: igitman/nemo-skills-nemo:0.6.1
104104
# ... there are some more containers defined here
105105
106106
env_vars:

docs/index.md

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -13,11 +13,12 @@ Here are some of the things we support.
1313
- [Model evaluation](pipelines/evaluation.md): Evaluate your models on many popular benchmarks
1414
- Math problem solving: math, aime24, aime25, omni-math (and many more)
1515
- Formal proofs in Lean: minif2f, proofnet
16-
- Coding skills: lcb, human-eval, mbpp
16+
- Coding skills: livecodebench, human-eval, mbpp
1717
- Chat/instruction following: ifeval, arena-hard, mt-bench
1818
- General knowledge: mmlu, mmlu-pro, gpqa
1919
- Long context: ruler
20-
- [Model training](pipelines/training.md): Train models at speed-of-light using [NeMo-Aligner](https://github.com/NVIDIA/NeMo-Aligner/).
20+
- [Model training](pipelines/training.md): Train models at speed-of-light using [NeMo-Aligner](https://github.com/NVIDIA/NeMo-Aligner/), [NeMo-RL](https://github.com/NVIDIA/NeMo-RL/) or [verl](https://github.com/volcengine/verl).
21+
2122

2223
To get started, follow this [tutorial](basics/index.md), browse available [pipelines](./pipelines/index.md) or run `ns --help` to see all available
2324
commands and their options.

docs/pipelines/evaluation.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,7 @@ We support many popular benchmarks and it's easy to add new in the future. E.g.
1111

1212
- Math problem solving: math, aime24, aime25, omni-math (and many more)
1313
- Formal proofs in Lean: minif2f, proofnet
14-
- Coding skills: lcb, human-eval, mbpp
14+
- Coding skills: livecodebench, human-eval, mbpp
1515
- Chat/instruction following: ifeval, arena-hard, mt-bench
1616
- General knowledge: mmlu, mmlu-pro, gpqa
1717
- Long context: ruler

docs/pipelines/generation.md

Lines changed: 10 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -320,12 +320,13 @@ Here are some suggestions on how to make your generation jobs more efficient
320320
random seed separately. We will run `.format(random_seed=random_seed)` on your command which lets you run the same
321321
logic on each output file, e.g.
322322

323-
```python
324-
generate(
325-
# ...
326-
postprocess_cmd="python /nemo_run/code/my_script.py --input <output_dir>/output-{random_seed}.jsonl"
327-
)
328-
```
329-
330-
If you need to run some logic that aggregates information from across all random seeds, you can instead schedule
331-
a dependent [run_cmd command](./run-cmd.md).
323+
```python
324+
cmd = f"python /nemo_run/code/my_script.py {output_dir}/output.jsonl"
325+
generate(
326+
# ...
327+
postprocess_cmd=cmd
328+
)
329+
```
330+
331+
If you need to run some logic that aggregates information from across all random seeds, you can instead schedule
332+
a dependent [run_cmd command](./run-cmd.md).

0 commit comments

Comments
 (0)