[GPU] Defer allocations of inputs#35126

Open

intbf wants to merge 15 commits intoopenvinotoolkit:masterfrom

intbf:gpu_defer_input_allocations

Commits on May 4, 2026

Defer allocations of inputs
intbf
committed
remove has_optimized_users which is not used and causes build error, remove comments
intbf
committed
remove the problematic comment with illegal characters for the codepage
intbf
committed
allocate memory for scalars that might assume the memory is not lazily allocated (like loop primitive)
intbf
committed
fix unit tests for memory pool
intbf
committed
keep eager allocation for blocked layout, call set_output_memory to properly update dependencies and internals, ensure _reset_arguments is called on set_input_data
intbf
committed
don't call set_output_memory when we set external mem ptr
intbf
committed
review comments: set _reset_arguments only when input was not allocated, code style and small refactor for unit tests
intbf
committed
rreview comments: primitive_inst check for input layout for the eltw mem, simplify handling of _in_out_shared_mem_types
intbf
committed
a unit test that verifies that build_deps() is safer to call before accessing input_memory_ptr in update_output_memory functions
intbf
committed
better handling of _in_out_shared_mem_types in set_input_data - move the push_back so that the new type is recorded even for mem change
intbf
committed
Apply suggestion from @Copilot - remove std::cout

intbf
and
Copilot
committed
move build_deps() to a safer spot for quantize and slice, fix a typo
intbf
committed
address comments about hardcoded numbers in unit test, explain them better
intbf
committed
extend unit tests for lazy input_layout memory allocation
intbf
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[GPU] Defer allocations of inputs#35126

[GPU] Defer allocations of inputs#35126
intbf wants to merge 15 commits intoopenvinotoolkit:masterfrom
intbf:gpu_defer_input_allocations

Commits on May 4, 2026

Defer allocations of inputs

remove has_optimized_users which is not used and causes build error, remove comments

remove the problematic comment with illegal characters for the codepage

allocate memory for scalars that might assume the memory is not lazily allocated (like loop primitive)

fix unit tests for memory pool

keep eager allocation for blocked layout, call set_output_memory to properly update dependencies and internals, ensure _reset_arguments is called on set_input_data

don't call set_output_memory when we set external mem ptr

review comments: set _reset_arguments only when input was not allocated, code style and small refactor for unit tests

rreview comments: primitive_inst check for input layout for the eltw mem, simplify handling of _in_out_shared_mem_types

a unit test that verifies that build_deps() is safer to call before accessing input_memory_ptr in update_output_memory functions

better handling of _in_out_shared_mem_types in set_input_data - move the push_back so that the new type is recorded even for mem change

Apply suggestion from @Copilot - remove std::cout

move build_deps() to a safer spot for quantize and slice, fix a typo

address comments about hardcoded numbers in unit test, explain them better

extend unit tests for lazy input_layout memory allocation