Support time travel using temporal version in Delta Lake #24801
+1,187
−5
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
chenjian2664
changed the title
chenjian2664
force-pushed
the
delta_time_travel
branch
4 times, most recently
from
991211c to
6cc05ca
Compare
|
You are my hero @chenjian2664 .. awesome job picking this up. |
chenjian2664
force-pushed
the
delta_time_travel
branch
2 times, most recently
from
2c9389f to
e9d28b7
Compare
wendigo
reviewed
Jan 29, 2025
wendigo
reviewed
Jan 29, 2025
| FROM example.testdb.customer_orders FOR TIMESTAMP AS OF TIMESTAMP '2022-03-23 09:59:29.803 Europe/Vienna'; | ||
| ``` | ||
|
|
||
| You can use a date to specify a point a time in the past for using a snapshot of a table in a query. |
There was a problem hiding this comment.
@mosabua please review docs part
wendigo
reviewed
Jan 29, 2025
plugin/trino-delta-lake/src/main/java/io/trino/plugin/deltalake/DeltaLakeMetadata.java
Outdated
Show resolved
Hide resolved
wendigo
reviewed
Jan 29, 2025
plugin/trino-delta-lake/src/main/java/io/trino/plugin/deltalake/DeltaLakeMetadata.java
Outdated
Show resolved
Hide resolved
wendigo
reviewed
Jan 29, 2025
...elta-lake/src/main/java/io/trino/plugin/deltalake/transactionlog/TemporalTimeTravelUtil.java
Show resolved
Hide resolved
wendigo
reviewed
Jan 29, 2025
...elta-lake/src/main/java/io/trino/plugin/deltalake/transactionlog/TemporalTimeTravelUtil.java
Show resolved
Hide resolved
findinpath
reviewed
Jan 29, 2025
findinpath
reviewed
Jan 29, 2025
plugin/trino-delta-lake/src/test/java/io/trino/plugin/deltalake/TestDeltaLakeBasic.java
Outdated
Show resolved
Hide resolved
findinpath
reviewed
Jan 29, 2025
findinpath
reviewed
Jan 29, 2025
...elta-lake/src/main/java/io/trino/plugin/deltalake/transactionlog/TemporalTimeTravelUtil.java
Outdated
Show resolved
Hide resolved
findinpath
reviewed
Jan 29, 2025
...elta-lake/src/main/java/io/trino/plugin/deltalake/transactionlog/TemporalTimeTravelUtil.java
Outdated
Show resolved
Hide resolved
ebyhr
reviewed
Jan 30, 2025
plugin/trino-delta-lake/src/main/java/io/trino/plugin/deltalake/DeltaLakeMetadata.java
Outdated
Show resolved
Hide resolved
plugin/trino-delta-lake/src/main/java/io/trino/plugin/deltalake/DeltaLakeMetadata.java
Outdated
Show resolved
Hide resolved
...sts/src/main/java/io/trino/tests/product/deltalake/TestDeltaLakeTimeTravelCompatibility.java
Outdated
Show resolved
Hide resolved
...elta-lake/src/main/java/io/trino/plugin/deltalake/transactionlog/TemporalTimeTravelUtil.java
Outdated
Show resolved
Hide resolved
...elta-lake/src/main/java/io/trino/plugin/deltalake/transactionlog/TemporalTimeTravelUtil.java
Outdated
Show resolved
Hide resolved
plugin/trino-delta-lake/src/test/java/io/trino/plugin/deltalake/TestDeltaLakeConnectorTest.java
Show resolved
Hide resolved
...elta-lake/src/main/java/io/trino/plugin/deltalake/transactionlog/TemporalTimeTravelUtil.java
Show resolved
Hide resolved
...sts/src/main/java/io/trino/tests/product/deltalake/TestDeltaLakeTimeTravelCompatibility.java
Outdated
Show resolved
Hide resolved
chenjian2664
force-pushed
the
delta_time_travel
branch
4 times, most recently
from
83c69f0 to
303f498
Compare
findinpath
reviewed
Feb 3, 2025
...st/resources/deltalake/v2_checkpoint_json_using_temporal/_delta_log/00000000000000000003.crc
Outdated
Show resolved
Hide resolved
findinpath
reviewed
Feb 3, 2025
plugin/trino-delta-lake/src/main/java/io/trino/plugin/deltalake/DeltaLakeMetadata.java
Outdated
Show resolved
Hide resolved
findinpath
reviewed
Feb 3, 2025
...elta-lake/src/main/java/io/trino/plugin/deltalake/transactionlog/TemporalTimeTravelUtil.java
Outdated
Show resolved
Hide resolved
findinpath
reviewed
Feb 3, 2025
...trino-delta-lake/src/test/resources/deltalake/v2_checkpoint_parquet_using_temporal/README.md
Show resolved
Hide resolved
findinpath
reviewed
Feb 3, 2025
...elta-lake/src/main/java/io/trino/plugin/deltalake/transactionlog/TemporalTimeTravelUtil.java
Outdated
Show resolved
Hide resolved
findinpath
reviewed
Feb 3, 2025
...elta-lake/src/main/java/io/trino/plugin/deltalake/transactionlog/TemporalTimeTravelUtil.java
Outdated
Show resolved
Hide resolved
chenjian2664
force-pushed
the
delta_time_travel
branch
4 times, most recently
from
9c2973f to
06dda61
Compare
chenjian2664
force-pushed
the
delta_time_travel
branch
from
06dda61 to
81685d8
Compare
chenjian2664
force-pushed
the
delta_time_travel
branch
4 times, most recently
from
3615aaf to
b1daa98
Compare
|
Would you mind to help to have another round review @ebyhr @mosabua @wendigo @findinpath |
|
This pull request has gone a while without any activity. Ask for help on #core-dev on Trino slack. |
|
@chenjian2664 can you rebase it and resolve conflicts? |
chenjian2664
force-pushed
the
delta_time_travel
branch
2 times, most recently
from
0848c0e to
3430d26
Compare
chenjian2664
force-pushed
the
delta_time_travel
branch
2 times, most recently
from
4ecacd5 to
59b6bbf
Compare
chenjian2664
force-pushed
the
delta_time_travel
branch
from
59b6bbf to
aa095ff
Compare
|
@mosabua Please help to review the doc part when you available, thanks |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
Fix #21024
Additional context and related issues
Release notes
( ) This is not user-visible or is docs only, and no release notes are required.
( ) Release notes are required. Please propose a release note for me.
(x) Release notes are required, with the following suggested text: