Skip to content

perf(kv-cache): cache get_avail_physical_pages in available_size to skip per-alloc cudaMemGetInfo - #456

Open
SuperMarioYL wants to merge 5 commits into
ovg-project:mainfrom
SuperMarioYL:perf/ttl-cache-avail-physical-pages
Open

perf(kv-cache): cache get_avail_physical_pages in available_size to skip per-alloc cudaMemGetInfo#456
SuperMarioYL wants to merge 5 commits into
ovg-project:mainfrom
SuperMarioYL:perf/ttl-cache-avail-physical-pages

fix(kv-cache): invalidate avail-physical-pages cache after pool mutation

faa9c7d
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning
CPU pytest (3.13)
succeeded Aug 21, 2026 in 51s