Skip to content

How to avoid NoAvailableBatchesError when there is no data #11049

Open
@CrossNox

Description

@CrossNox

So, I have setup a checkpoint that has several validation definitions, one per asset.

The goal is to validate new data from yesterday every day. But if one of those assets does not have new data for the given batch parameters, running the checkpoint will fail raising NoAvailableBatchesError.

This seems to be the expected behaviour from a look into the tests.

How do I get around this?

IMHO if there's no data, expectations should not fail, as nothing is breaking the data contract it establishes.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    Status

    To Do

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions