Skip to content

[Serve] sky serve status should show ready replicas at the top and ordered by the version #3052

Open
@Michaelvll

Description

@Michaelvll

Currently the sky serve status show the replicas by the order of ID. However, the latest READY replicas should be more important and interesting to the user. Also, when the number of replicas increase, the current implementation hides the latest replicas, which is unexpected.

sky serve status
Services
NAME        VERSION  UPTIME      STATUS  REPLICAS  ENDPOINT            
code-llama  3        2h 15m 59s  READY   1/6       x.x.x.x:30002  

Service Replicas
SERVICE_NAME  ID  VERSION  IP             LAUNCHED    RESOURCES                    STATUS        REGION    
code-llama    1   1        -              -           -                            FAILED        -         
code-llama    2   1        x.x.x.x  2 hrs ago   1x Azure({'A100-80GB': 2}))  READY         eastus    
code-llama    3   1        -              -           -                            FAILED        -         
code-llama    4   1        -              -           -                            FAILED        -         
code-llama    5   1        -              -           -                            FAILED        -         
code-llama    6   1        -              -           -                            FAILED        -         
code-llama    7   1        -              1 min ago   1x Azure({'A100-80GB': 2}))  PROVISIONING  westus3   
code-llama    8   2       x.x.x.x  1 min ago   1x Azure({'A100-80GB': 2}))  STARTING      eastus    
code-llama    9   2        -              5 mins ago  1x Azure({'A100-80GB': 2}))  PROVISIONING  eastus    
code-llama    10  3        -              2 mins ago  1x GCP({'L4': 8}))           PROVISIONING  us-east4  
... (use --all to show all replicas)

Several things we should do:

  1. Make sure the later versions show at the top
  2. Have the ready replicas shown first

Metadata

Metadata

Assignees

No one assigned

    Labels

    P0enhancementNew feature or requestservefeatures/bugs related to sky serve

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions