perf(kv-cache): cache get_avail_physical_pages in available_size to skip per-alloc cudaMemGetInfo - #456

perf(kv-cache): cache get_avail_physical_pages in available_size to skip per-alloc cudaMemGetInfo#456

SuperMarioYL wants to merge 5 commits into

ovg-project:mainovg-project/kvcached:mainfrom

SuperMarioYL:perf/ttl-cache-avail-physical-pagesSuperMarioYL/kvcached:perf/ttl-cache-avail-physical-pagesCopy head branch name to clipboard