-
Notifications
You must be signed in to change notification settings - Fork 458
[KV] Support configurable change log image mode for Primary Key Tables #2105
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
64270e1 to
0844d64
Compare
fluss-common/src/main/java/org/apache/fluss/config/ConfigOptions.java
Outdated
Show resolved
Hide resolved
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for the updates, the refactoring and method extraction of KvTablet is very nice!
Could you add an Flink IT Case that updates and deletes to a table with WAL mode + default merge engine, and then (1) read and verify the changelogs of the table. (2) Do aggregation on the table and produce correct final result (verify there is a ChangelogNormalze node generated for the source to guarantee a normalized changelog for aggregation).
fluss-common/src/main/java/org/apache/fluss/metadata/ChangelogImage.java
Outdated
Show resolved
Hide resolved
fluss-server/src/test/java/org/apache/fluss/server/kv/KvTabletTest.java
Outdated
Show resolved
Hide resolved
|
I appended a commit to add back some code comments of |
|
@wuchong I'v updated this PR and resolved all comments, thanks for review again. |
…age mode for Primary Key Tables (apache#2105)" This reverts commit e5d10ac.
… for Primary Key Tables (apache#2105) Co-authored-by: Jark Wu <[email protected]>
Purpose
Linked issue: close #2102
Brief change log
Tests
API and Format
Documentation