Skip to content

Iceberg Integration documentation #5918

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 68 commits into
base: master
Choose a base branch
from
Draft

Iceberg Integration documentation #5918

wants to merge 68 commits into from

Conversation

MeelahMe
Copy link
Contributor

@MeelahMe MeelahMe commented Mar 19, 2025

Description

To introduce documentation for the new Iceberg integration with Snowflake for InfluxDB Cloud Dedicated. To create documentation that allows users to export time series data snapshots into Apache Iceberg format and query them directly from Snowflake—without the need for complex ETL processes.

To-do

  • Feature overview and benefits
  • Create steps to request and configure the integration via InfluxData Sales and Support
  • Explain details on how the InfluxData team sets up the Snowflake external stage and catalog
  • Share a export process overview, including current limitations (e.g., customer-triggered exports not yet supported)
  • Explain guidance for querying Iceberg tables in Snowflake
  • Talk about considerations and known limitations

Why This Matters

This documentation gives users the information they need to request access and understand the setup and usage of the integration clearly and confidently.

Copy link
Contributor

@jstirnaman jstirnaman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall, this looks good. My suggestions are mostly for following our style and "tightening up". We should add examples where noted ASAP, but it shouldn't necessarily hold up publishing when the feature is ready.

@MeelahMe
Copy link
Contributor Author

Thank you for the suggestions and help! I should probably go slower and triple check that I am using the Google developers documentation style guide. @jstirnaman

@MeelahMe MeelahMe added Feature-WIP Feature is still a work in progress and is not yet merged. and removed InfluxDB Cloud Dedicated InfluxDB Cloud Serverless labels Mar 19, 2025
@MeelahMe MeelahMe changed the title WIP: Iceberg Integration documentation Iceberg Integration documentation Mar 26, 2025
MeelahMe and others added 2 commits March 26, 2025 16:36
- Add directory and frontmatter
- Revise content to be Cloud Dedicated specific, omitting implementation and config detail that will be handled by InfluxData Support
- Fix code samples
- Organize, clean up headings

- TODO: Comment out influxctl and API code if necessary (until features are completed)
- TODO: Verify details with PM
- TODO: Move content as noted in the iceberg-for-snowflake.md comment
Copy link
Contributor

@jstirnaman jstirnaman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In addition to the notes here, I'm pushing an update to your branch--I'll PR so you can see the diff.

@MeelahMe MeelahMe marked this pull request as ready for review March 31, 2025 18:35
@jstirnaman jstirnaman marked this pull request as draft April 2, 2025 20:06
@jstirnaman jstirnaman added the Pending Release Waiting on a product release label Apr 2, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation feat Feature-WIP Feature is still a work in progress and is not yet merged. Pending Release Waiting on a product release
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants