add kv quant example#2100

mengniwang95 wants to merge 6 commits intovllm-project:mainvllm-project/llm-compressor:mainfrom

mengniwang95:kv_examplemengniwang95/llm-compressor:kv_exampleCopy head branch name to clipboard