Skip to content

Commit 2342989

Browse files
committed
Only LLMs scalar constant nodes need to be checked for saturation to further optimize model compile time
1 parent 9ebe7f5 commit 2342989

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

src/plugins/intel_cpu/src/nodes/input.cpp

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -402,8 +402,9 @@ void Input::cloneBlobIfRequired() {
402402
if (!size)
403403
return;
404404

405+
// Only LLMs scalar constant nodes with bf16 inferencePrecision need to be checked for saturation
405406
const bool do_bf16_saturation_check =
406-
(context->getConfig().inferencePrecision == ov::element::bf16) ? true : false;
407+
(context->getConfig().inferencePrecision == ov::element::bf16 && size == 1) ? true : false;
407408

408409
#if defined(OPENVINO_ARCH_X86_64)
409410
auto fn = jit_has_subnormals_function();

0 commit comments

Comments
 (0)