LocalVLLMModel and deployment handler#102

Merged

michaelharrisonmai merged 14 commits intomainfrom mharrison/local-vllm-model

Mar 17, 2025

Commits on Feb 27, 2025

introduce LocalVLLMModel
Michael Harrison
committed

Commits on Mar 4, 2025

improved functionality for vllm deployments
Michael Harrison
committed

Commits on Mar 5, 2025

example script to deploy servers and run pipeline
Michael Harrison
committed

Commits on Mar 6, 2025

improved localvllm logic
Michael Harrison
committed
retrigger checks
Vidhisha Balachandran
committed
Merge branch 'mharrison/local-vllm-model' of https://github.com/microsoft/eureka-ml-insights into mharrison/local-vllm-model
Vidhisha Balachandran
committed
retrigger checks
Vidhisha Balachandran
committed

Commits on Mar 12, 2025

removed unused import, better example model, more explicit error
Michael Harrison
committed
Merge branch 'main' into mharrison/local-vllm-model
Michael Harrison
committed

Commits on Mar 13, 2025

added lock/dict to prevent multiple deployments of same model_name
Michael Harrison
committed

Commits on Mar 14, 2025

bad typo => useless lock
Michael Harrison
committed

Commits on Mar 15, 2025

background threads need to be daemon, otherwise main thread never finishes
Michael Harrison
committed
The next commit will build on updates from concur branch.
Michael Harrison
committed
inherit from EndpointModel, fix shutdown logic
Michael Harrison
committed