Skip to content

Update Glue Table Input (E3002 ) - Issue: 'IcebergTableInput' not in allowed in OpenTableFormatInput #4376

@nafrench

Description

@nafrench

Is this feature request related to a new rule or cfn-lint capabilities?

rules

Describe the feature you'd like to request

Rule doesn't support the new IcbergInput configuration, additional information can be found here: https://aws.amazon.com/blogs/big-data/create-and-update-apache-iceberg-tables-with-partitions-in-the-aws-glue-data-catalog-using-the-aws-sdk-and-aws-cloudformation/

Describe the solution you'd like

Update logic to support new Iceberg configuration e.g:
Resources: CfnIcebergTable: Type: AWS::Glue::Table Properties: CatalogId: !Ref AWS::AccountId DatabaseName: !Ref DatabaseName Name: !Ref TableName OpenTableFormatInput: IcebergInput: MetadataOperation: "CREATE" Version: "2" IcebergTableInput: Location: "s3://sampledatabucket/bankdataiceberg/transactiontable2/" Schema: Type: "struct" Fields: - Name: "transaction_id" Type: "string" Id: 1 Required: true - Name: "transaction_name" Type: "string" Id: 2 Required: true - Name: "transaction_amount" Type: "float" Id: 3 Required: true - Name: "transaction_date" Type: "float" Id: 4 Required: true PartitionSpec: SpecId: 1 Fields: - SourceId: 1 Transform: "identity" Name: "transaction_id" - SourceId: 4 Transform: "year" Name: "transaction_date" WriteOrder: OrderId: 1 Fields: - SourceId: 1 Transform: "identity" Direction: "asc" NullOrder: "nulls-last"

Additional context

No response

Is this something that you'd be interested in working on?

  • 👋 I may be able to implement this feature request

Would this feature include a breaking change?

  • ⚠️ This feature might incur a breaking change

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions