Skip to content

Commit d4f0d50

Browse files
committed
docs(recipes): document the offloaded layerwise export recipe
The recipe shipped undocumented; the parent branch's docs test now requires a row and the count kept in step. Signed-off-by: Fridah-nv <201670829+Fridah-nv@users.noreply.github.com>
1 parent 0b369dd commit d4f0d50

1 file changed

Lines changed: 2 additions & 1 deletion

File tree

modelopt_recipes/ptq.md

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -29,7 +29,7 @@ supported combinations.
2929
### The shipped recipes
3030

3131
<details>
32-
<summary>All 25 <code>general/ptq/</code> recipes (click to expand)</summary>
32+
<summary>All 26 <code>general/ptq/</code> recipes (click to expand)</summary>
3333

3434
| Recipe | Model body | KV cache | Calibration |
3535
|--------|-----------|----------|-------------|
@@ -49,6 +49,7 @@ supported combinations.
4949
| `nvfp4_experts_only-kv_fp8_layerwise` | NVFP4 W4A4, MoE experts only | FP8 (calibrated) | max, layerwise |
5050
| `nvfp4_experts_only-kv_fp8_layerwise_offload` | NVFP4 W4A4, MoE experts only | FP8 (calibrated) | max, layerwise (non-mutating, for disk offload) |
5151
| `nvfp4_experts_only-kv_fp8_layerwise_export` | NVFP4 W4A4, MoE experts only | FP8 (calibrated) | max, layerwise (exports each layer as it is calibrated) |
52+
| `nvfp4_experts_only-kv_fp8_layerwise_export_offload` | NVFP4 W4A4, MoE experts only | FP8 (calibrated) | max, layerwise, tuned for accelerate-offloaded models |
5253
| `nvfp4_experts_only_mse-kv_fp8_cast` | NVFP4 W4A4, MoE experts only | FP8 (constant amax) | MSE + FP8 sweep |
5354
| `nvfp4_experts_only_input_scale1-kv_fp8_cast` | NVFP4 W4A4, MoE experts only, expert `input_scale` pinned to 1.0 | FP8 (constant amax) | max (weights); expert activations uncalibrated |
5455
| `nvfp4_omlp_only-kv_fp8` | NVFP4 W4A4, o_proj + MLP/MoE | FP8 (calibrated) | max |

0 commit comments

Comments
 (0)