Skip to content

[BUG] Validate that routes configured in the sink exist on startup of Data Prepper #5106

Open
@graytaylor0

Description

@graytaylor0

Describe the bug
Currently, data prepper does not validate that routes exist on startup, and even during runtime will not throw any errors.

To Reproduce
Steps to reproduce the behavior:
Create a config like

routes:
    - route_one: '/my_route == 10'
    - route_two: '/my_route == 11'
  sink:
    - pipeline:
        name: "sub-pipeline-1"
        routes:
          - FIRST_ROUTE
    - pipeline:
        name: "sub-pipeline-2"
        routes:
          - SECOND_ROUTE

None of the data will be routed to either pipeline, and there will be no errors or validations

Expected behavior
Throw a validation error when a route is defined in the sink that does not exist. For the above, this may look like

Route "FIRST_ROUTE" does not exist. Configured routes include [resources_route, resource_route]

Screenshots
If applicable, add screenshots to help explain your problem.

Environment (please complete the following information):

  • OS: [e.g. Ubuntu 20.04 LTS]
  • Version [e.g. 22]

Additional context
Add any other context about the problem here.

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workinggood first issueGood for newcomers

    Type

    No type

    Projects

    • Status

      In progress

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions