Skip to content

Upgrade pyarrow to version 21 #3207

@willm

Description

@willm

Is your idea related to a problem? Please describe.
Within our project, we use pyarrow and awswrangler. We've encountered a bug in version 20 of pyarrow when you have a schema with a column containing a complex type. This is fixed in version 21 however we get an error about pyarrow 21 not being compatible with awswrangler

Describe the solution you'd like
AWS wrangler to upgrade to pyarrow 21 so that we can use this version everywhere and fix the bug

P.S. Please do not attach files as it's considered a security risk. Add code snippets directly in the message body as much as possible.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions