The Iceberg Catalog Migrator is a command-line tool that enables bulk migration of Apache Iceberg tables from one Iceberg Catalog to another without the need to copy the data. This tool works with all Iceberg Catalogs; not just Polaris.
The migrator tool provides two operations:
- Migrate - Bulk migration of the Iceberg tables from source catalog to target catalog. Table entries from source catalog will be deleted after the successful migration to the target catalog.
- Register - Bulk register the Iceberg tables from source catalog to target catalog.
⚠️ registercommand just registers the table. Which means the table will be present in both the catalogs after registering. Operating same table from more than one catalog can lead to missing updates, loss of data, and table corruption. It is recommended to use the 'migrate' command in CLI to automatically delete the table from source catalog after registering or avoid operating tables from the source catalog after registering if 'migrate' command is not used.
⚠️ Avoid using this tool when there are in-progress commits for tables in the source catalog to prevent missing updates, data loss and table corruption in the target catalog. In-progress commits may not be properly transferred and could compromise the integrity of your data.
Please use the getting started guide for a step-by-step guide on how to use the tool.
Please use the examples guide to learn about the different options available in the tool.