Adjust traffic routing dynamically for tfserving jobs
Adjust traffic routing dynamically for tfserving jobs
arena serve traffic-split [flags]
-h, --help help for traffic-split
--servingName string the serving name
--servingVersions string Model versions which the traffic will be routed to, e.g. 1,2,3
--weights string Weight percentage values for each model version which the traffic will be routed to,e.g. 70,20,10
--arena-namespace string The namespace of arena system service, like tf-operator (default "arena-system")
--config string Path to a kube config. Only required if out-of-cluster
--loglevel string Set the logging level. One of: debug|info|warn|error (default "info")
-n, --namespace string the namespace of the job (default "default")
--pprof enable cpu profile
--trace enable trace
- arena serve - Serve a job.