Skip to content

[runtime] Add FIFO scheduling #1405

Open
@iyzhang

Description

@iyzhang

Context

Our current scheduler only has a round-robin scheduling policy, which is good for fairness but not for tail latency.

Proposed Solution

Add an additional scheduling policy for FIFO.

Alternative Solutions

We could replace the round-robin scheduler totally with FIFO but having both is useful.

Metadata

Metadata

Assignees

Labels

enhancementEnhancement Request on an Existing Feature

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions