Feature request / 功能建议
Is it possible to support the dynamic addition of model replicas? Dynamic deletion of deployed replicas is already supported.
Motivation / 动机
For instance, sometimes when we restart a specific worker for some reason and wish to add more replicas without stopping the existing ones,we do not want to stop the inference service. This approach offers greater flexibility and facilitates operations and maintenance.
Your contribution / 您的贡献
Feature request / 功能建议
Is it possible to support the dynamic addition of model replicas? Dynamic deletion of deployed replicas is already supported.
Motivation / 动机
For instance, sometimes when we restart a specific worker for some reason and wish to add more replicas without stopping the existing ones,we do not want to stop the inference service. This approach offers greater flexibility and facilitates operations and maintenance.
Your contribution / 您的贡献