feat(pipeline_parallel): support single-host pipeline parallelism for Llama - #3496

feat(pipeline_parallel): support single-host pipeline parallelism for Llama#3496

aashishrampal-lab wants to merge 3 commits into

vllm-project:mainvllm-project/tpu-inference:mainfrom

aashishrampal-lab:pr/pp-single-host-llamaaashishrampal-lab/tpu-inference:pr/pp-single-host-llamaCopy head branch name to clipboard