Add --render-endpoint to prepare_data.py for vLLM-delegated tokenization (#652)#665

WindChimeRan wants to merge 15 commits into

vllm-project:mainvllm-project/speculators:mainfrom

WindChimeRan:652-render-preprocessingWindChimeRan/speculators:652-render-preprocessingCopy head branch name to clipboard