chore: upgrade datafusion, arrow and parquet

[dentiny]

Description

This PR upgrades parquet, arrow and datafusion to their latest version.

Motivation:

• I'm working on a project which supports both datafusion as query engine, and iceberg / delta as storage backend
• Currently iceberg and delta have different dependent versions of df/arrow/parquet, which makes it hard to find a compatible version and make them live in the same project
• This PR upgrades all of them to their latest version, I'm pushing the same effort on iceberg side

[github-actions]

ACTION NEEDED

delta-rs follows the Conventional Commits specification for release automation.

The PR title and description are used as the merge commit message. Please update your PR title and description to match the specification.

[rtyler]

These version numbers certainly should have been more relaxed, we got burned on a patch release in the last major version of arrow, thus the strictness.

Thanks for updating!

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 73.75%. Comparing base (bffdece) to head (bb5732b).
⚠️ Report is 1 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #3856      +/-   ##
==========================================
- Coverage   73.76%   73.75%   -0.02%     
==========================================
  Files         151      151              
  Lines       39139    39117      -22     
  Branches    39139    39117      -22     
==========================================
- Hits        28871    28850      -21     
  Misses       8997     8997              
+ Partials     1271     1270       -1     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.