feat: add GPU memory tracking utilities#16224

codebasecomprehension wants to merge 2 commits intosgl-project:mainsgl-project/sglang:mainfrom

codebasecomprehension:feature/gpu-memory-utilitycodebasecomprehension/sglang:feature/gpu-memory-utilityCopy head branch name to clipboard