Skip to content

Marquez dataset & job notifications' panel #1973

Open
@pawel-big-lebowski

Description

@pawel-big-lebowski

Several things can happen within a dataset or a job:

  • a new column has been added
  • dataset content was truncated 3 days ago
  • job is failing since column renamed

As a data engineer I can think of plenty of such scenarios. We do have in Marqeuz all the information to detect it but it is not that easy to visualize them. As a a data engineer, with a limited web UI skills, it is hard for me to make use of this information although I know how valuable it is.

In each dataset/job view we could have something like Notifications where such information can be presented. This would allow other Marquez contributors to implement their own notifications or alerts.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions