SNOW-2047992: Support for newer pyarrow versions (>19.0.0)

[kang8]

What is the current behavior?

The snowflake-connector-python package currently has a version restriction for pyarrow in its pandas extra requirements: pyarrow<19.0.0 (as seen in setup.cfg). This prevents users from using the latest pyarrow versions with the connector.

What is the desired behavior?

Update or remove the upper version limit on pyarrow dependency to allow using the latest pyarrow versions with the Snowflake connector.

How would this improve snowflake-connector-python?

This change would allow users to:

• Use the latest pyarrow releases with snowflake-connector-python
• Avoid dependency conflicts in projects that require newer pyarrow versions
• Benefit from performance improvements and bug fixes in newer pyarrow versions
• Simplify dependency management in projects using both snowflake-connector-python and other libraries that depend on pyarrow

References and other background

I noticed this restriction was added in PR #2163. If there were specific compatibility issues that led to this constraint, it would be helpful to understand if those have been resolved or if there's a timeline for supporting newer versions of pyarrow.

[sfc-gh-sghosh]

Hello @kang8 ,

Thanks for raising the issue, we will check and update whether pyarrow versions > 19.0.0 is supported or not, if not why.

Regards,
Sujan

[sfc-gh-sghosh]

Hello @kang8 ,

Currently, the fix will tentatively be delivered by mid-May 2025.

Regards,
Sujan