DuckDBPolarsIOManager with partitioned assets #33015
Unanswered
chrwnz-eng
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Dear community,
I'm struggling with I/O Manager (DuckDBPolarsIOManager) and partitioned assets. I defined the following asset:
The materialization and the persistence in the DuckDB works fine if I run this asset. With the help of another asset I try to load these data from the first asset and transform them.
Unfortunately is the DataFrame extract_change_requests in the asset transform_change_requests empty. If I remove the partition_def and the metadata in the annotation of transform_change_requests the mentioned DataFrame is populated with data. Please, could somebody explain this to me and give me a hint how to use partions also in the asset transform_change_requests.
BR
Beta Was this translation helpful? Give feedback.
All reactions