chore: upgrade to delta-kernel-rs 0.16.0 and remove more dependencies #10221

Job	Run time
Python Build (Python 3.10 PyArrow latest)	4m 54s
test-minimal	4m 54s
Python Build (Python 3.10 Unity Catalog Integration tests)	6m 47s
Python Build (Python 3.10 LakeFS Integration tests)	6m 11s
Running with Python 3.9	5m 43s
Python Build (Python 3.10 Unity Catalog Integration tests)	5m 56s
Running with Python 3.10	5m 50s
PySpark Integration Tests	6m 59s
Running with Python 3.12	6m 10s
Running with Python 3.11	5m 39s
	59m 3s

Provide feedback