chore: Datafusion 54 upgrade #8595

Job	Run time
Lint	34s
Build Native Library (macOS)	32m 23s
macos-14/Spark 4.0, JDK 17, Scala 2.13 [csv]	5m 36s
macos-14/Spark 4.0, JDK 17, Scala 2.13 [exec]	21m 53s
macos-14/Spark 4.0, JDK 17, Scala 2.13 [parquet]	11m 42s
macos-14/Spark 4.0, JDK 17, Scala 2.13 [shuffle]	12m 51s
macos-14/Spark 4.0, JDK 17, Scala 2.13 [fuzz]	14m 41s
macos-14/Spark 4.1, JDK 17, Scala 2.13 [fuzz]	20m 28s
macos-14/Spark 4.1, JDK 17, Scala 2.13 [exec]	14m 25s
macos-14/Spark 4.0, JDK 17, Scala 2.13 [sql]	5m 10s
macos-14/Spark 4.1, JDK 17, Scala 2.13 [shuffle]	15m 7s
macos-14/Spark 4.1, JDK 17, Scala 2.13 [csv]	5m 7s
macos-14/Spark 4.0, JDK 17, Scala 2.13 [expressions]	22m 37s
macos-14/Spark 4.1, JDK 17, Scala 2.13 [expressions]	28m 29s
macos-14/Spark 4.1, JDK 17, Scala 2.13 [sql]	5m 39s
macos-14/Spark 4.2, JDK 17, Scala 2.13 [csv]	6m 6s
macos-14/Spark 4.2, JDK 17, Scala 2.13 [shuffle]	13m 27s
macos-14/Spark 4.1, JDK 17, Scala 2.13 [parquet]	12m 37s
macos-14/Spark 4.2, JDK 17, Scala 2.13 [exec]	15m 1s
macos-14/Spark 4.2, JDK 17, Scala 2.13 [fuzz]	18m 8s
macos-14/Spark 4.2, JDK 17, Scala 2.13 [expressions]	21m 45s
macos-14/Spark 4.2, JDK 17, Scala 2.13 [parquet]	10m 45s
macos-14/Spark 4.2, JDK 17, Scala 2.13 [sql]	7m 10s
	5h 21m 41s

Provide feedback