-
Notifications
You must be signed in to change notification settings - Fork 461
[Docs] Fluss/flink - Iceberg quickstart guide #1800
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Docs] Fluss/flink - Iceberg quickstart guide #1800
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Pull Request Overview
This PR adds a new Iceberg quickstart guide for Fluss, demonstrating real-time analytics with Flink and Apache Iceberg integration using Hadoop catalog. It separates the existing Flink guide to focus on Paimon, creating distinct documentation paths for different lake storage formats.
Key Changes:
- Created new Flink-Iceberg quickstart guide with comprehensive tutorial including Docker setup, table creation, and lakehouse integration
- Renamed existing Flink guide to specify Paimon integration and updated references
- Added Hadoop JAR support in distribution plugins for Iceberg catalog functionality
Reviewed Changes
Copilot reviewed 4 out of 4 changed files in this pull request and generated 2 comments.
| File | Description |
|---|---|
| website/docs/quickstart/flink-paimon.md | Updated title to specify Paimon integration |
| website/docs/quickstart/flink-iceberg.md | New comprehensive Iceberg quickstart guide with Docker setup and examples |
| website/docs/intro.md | Updated quickstart link to point to Paimon-specific guide |
| fluss-dist/src/main/assemblies/plugins.xml | Added Hadoop JAR dependency for Iceberg plugin support |
Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.
luoyuxia
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@MehulBatra Thanks for the pr. Left some comments.
8526dc5 to
3542d23
Compare
|
Thank you @luoyuxia for the review and feedback, addressed your comments, please have a look! |
luoyuxia
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@MehulBatra Thanks for update.
1: The ci fail
2: Also, I notice in the descrition #1727 (comment), it's suggested paimon to be a tab, iceberg to be another tab instead of pages. Is it possible to make them as tabs. I think tabs will be more unified to avoid introduce two many pages.
If make them as tabs is not easy, I don't mind change them to tabs in another pr. |
I think we can take that as a seperate PR as it will introduce more changes, I am thinking to get this merged before flink forward session |
|
somehow it's passing in my local but failing here 😓 |
c5df208 to
77a696b
Compare
77a696b to
ecf0b27
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Pull Request Overview
Copilot reviewed 3 out of 3 changed files in this pull request and generated 1 comment.
Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.
|
@MehulBatra I revert to refer to |
luoyuxia
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@MehulBatra Left some comments again. PTAL
luoyuxia
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
+1
--------- Co-authored-by: luoyuxia <[email protected]>
Purpose
Linked issue: close #1727
Brief change log
$lake$snapshots) is currently in development and referenced issue Lake table decouple with Paimon #1559.
Tests
Verified the guide by running manually on my local
API and Format
Documentation