Skip to content

Commit 5471cbf

Browse files
Exclude GPU device for grammar correction notebook (openvinotoolkit#2341)
There are accuracy issues for grammar correction encoder model on GPU **Ticket** 127998
1 parent 51ab6f8 commit 5471cbf

File tree

1 file changed

+3
-2
lines changed

1 file changed

+3
-2
lines changed

notebooks/grammar-correction/grammar-correction.ipynb

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -224,7 +224,7 @@
224224
"\n",
225225
"from notebook_utils import device_widget\n",
226226
"\n",
227-
"device = device_widget()\n",
227+
"device = device_widget(default=\"CPU\", exclude=[\"AUTO\", \"GPU\"])\n",
228228
"\n",
229229
"device"
230230
]
@@ -950,6 +950,7 @@
950950
],
951951
"source": [
952952
"from utils import get_quantized_pipeline, CALIBRATION_DATASET_SIZE\n",
953+
"import openvino as ov\n",
953954
"\n",
954955
"grammar_corrector_pipe_fp32 = grammar_corrector_pipe\n",
955956
"grammar_corrector_pipe_int8 = None\n",
@@ -958,7 +959,7 @@
958959
" grammar_corrector_pipe_int8 = get_quantized_pipeline(\n",
959960
" grammar_corrector_pipe_fp32,\n",
960961
" grammar_corrector_tokenizer,\n",
961-
" core,\n",
962+
" ov.Core(),\n",
962963
" grammar_corrector_dir,\n",
963964
" quantized_model_path,\n",
964965
" device.value,\n",

0 commit comments

Comments
 (0)