Add QNN EP HTP shared memory allocator#23136

Merged

edgchen1 merged 61 commits intomainfrom

edgchen1/qnn_ep_rpcmem

Jan 14, 2025

Commits on Nov 5, 2024

save work
edgchen1
committed

Commits on Nov 9, 2024

save work
edgchen1
committed

Commits on Nov 11, 2024

add logging for setting QNN tensor memory, update comment
edgchen1
committed
add option to enable HTP shared memory allocator to onnxruntime_perf_test
edgchen1
committed

Commits on Nov 12, 2024

hack - try to cache mem handles in QnnModel
edgchen1
committed

Commits on Nov 14, 2024

Commits on Nov 15, 2024

Commits on Nov 19, 2024

Merge remote-tracking branch 'origin/main' into edgchen1/qnn_ep_rpcmem
edgchen1
committed

Commits on Nov 27, 2024

rename to RpcMemAllocator to HtpSharedMemoryAllocator
edgchen1
committed

Commits on Dec 2, 2024

Merge remote-tracking branch 'origin/main' into edgchen1/qnn_ep_rpcmem
edgchen1
committed

Commits on Dec 3, 2024

remove onnx protobuf dependency from allocator.h, add shared provider declarations and definitions for IAllocator::TensorAlloc().
edgchen1
committed

Commits on Dec 5, 2024

Commits on Dec 11, 2024

remove shared mem handles from shared context
edgchen1
committed

Commits on Dec 16, 2024

remove allocation clean up callback removal, use weak_ptrs in allocation clean up callback
edgchen1
committed

Commits on Dec 18, 2024

Commits on Jan 7, 2025

document GetOrRegister functions
edgchen1
committed

Commits on Jan 8, 2025

add enable_htp_shared_memory_allocator to available_keys
edgchen1
committed

Commits on Jan 10, 2025

Commits on Jan 13, 2025