feat: allow OptimizeBuilder to accept SessionConfig for finer-grained control of execution #10210

Job	Run time
Python Build (Python 3.10 PyArrow latest)	6m 29s
test-minimal	4m 59s
PySpark Integration Tests	6m 42s
Python Build (Python 3.10 LakeFS Integration tests)	6m 9s
Python Build (Python 3.10 Unity Catalog Integration tests)	6m 5s
Python Build (Python 3.10 Unity Catalog Integration tests)	6m 12s
Running with Python 3.11	5m 42s
Running with Python 3.12	5m 47s
Running with Python 3.9	5m 39s
Running with Python 3.10	6m 18s
	1h 0m 2s

Provide feedback