Skip to content

Commit 1d5dde7

Browse files
authored
[Docs] Add optimum-cli export command with quantization for Whisper use case page (openvinotoolkit#3105)
## Description This PR updates the speech recognition (Whisper) use case page to demonstrate both default and INT8 quantized optimum-cli export options. Preview: https://yatarkan.github.io/openvino.genai/docs/use-cases/speech-recognition/ ## Checklist: - [x] Tests have been updated or added to cover the new code - **N/A** - [x] This patch fully addresses the ticket - [x] I have made corresponding changes to the documentation
1 parent e99efda commit 1d5dde7

File tree

2 files changed

+23
-1
lines changed

2 files changed

+23
-1
lines changed

site/docs/use-cases/speech-recognition/index.mdx

Lines changed: 8 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,14 @@ import UsageOptionsSection from './_sections/_usage_options/index.mdx';
1111
<ConvertModelSection>
1212
Download and convert model (e.g. [openai/whisper-base](https://huggingface.co/openai/whisper-base)) to OpenVINO format from Hugging Face:
1313

14-
<OptimumCLI model='openai/whisper-base' outputDir='whisper_ov' trustRemoteCode />
14+
<Tabs groupId="whisper-export-command">
15+
<TabItem label="Default" value="default">
16+
<OptimumCLI model='openai/whisper-base' outputDir='whisper_ov' trustRemoteCode />
17+
</TabItem>
18+
<TabItem label="INT8 Static Quantization" value="int8_quant">
19+
<OptimumCLI model='openai/whisper-base' outputDir='whisper_ov_int8' trustRemoteCode quantMode='int8' dataset='librispeech' numSamples={32} />
20+
</TabItem>
21+
</Tabs>
1522

1623
See all supported [Speech Recognition Models](/docs/supported-models/#speech-recognition-models-whisper-based).
1724
</ConvertModelSection>

site/src/components/OptimumCLI/index.tsx

Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -7,6 +7,9 @@ type OptimumCLIProps = {
77
task?: string;
88
trustRemoteCode?: boolean;
99
modelKwargs?: Record<string, string>;
10+
quantMode?: 'int8';
11+
dataset?: string;
12+
numSamples?: number;
1013
};
1114

1215
export default function OptimumCLI({
@@ -16,6 +19,9 @@ export default function OptimumCLI({
1619
task,
1720
trustRemoteCode,
1821
modelKwargs,
22+
quantMode,
23+
dataset,
24+
numSamples,
1925
}: OptimumCLIProps): React.JSX.Element {
2026
const args = [`--model ${model}`];
2127
if (weightFormat) {
@@ -24,6 +30,15 @@ export default function OptimumCLI({
2430
if (task) {
2531
args.push(`--task ${task}`);
2632
}
33+
if (quantMode) {
34+
args.push(`--quant-mode ${quantMode}`);
35+
}
36+
if (dataset) {
37+
args.push(`--dataset ${dataset}`);
38+
}
39+
if (numSamples) {
40+
args.push(`--num-samples ${numSamples}`);
41+
}
2742
if (trustRemoteCode) {
2843
args.push('--trust-remote-code');
2944
}

0 commit comments

Comments
 (0)