Replies: 1 comment
-
|
@alexott Would you agree, that Lakehouse monitoring is also more about metrics (calculated score using aggregation), and not data quality checks (e.g. certain values not allowed, and rows flagged accordingly) like DQX? |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Lakehouse Monitoring should be your first choice if you need post-factum data quality monitoring (once data is written to a table). Use DQX if you need pro-active monitoring (before data is written to a target table).
DQX can prevent corrupted data from reaching your cleaned/silver table, while Lakehouse Monitoring only detects them after they are already in the table. This is also one of the reasons why we built DQX.
Beta Was this translation helpful? Give feedback.
All reactions