Try this as a python fix

Spark commit apache/spark@52dfa3d#diff-0a22271fecb7c4a38d8afe18ac8676546f1ad8fd221ccc0a5e4cfacdee869298

But could also be related to apache/spark@3b4c423#diff-0a22271fecb7c4a38d8afe18ac8676546f1ad8fd221ccc0a5e4cfacdee869298 which adds self.log_exception() which is what is throwing the exception

Author: allisonport-db

python/delta/exceptions.py

@@ -151,7 +151,7 @@ def _patch_convert_exception() -> None:
     Patch PySpark's exception convert method to convert Delta's Scala concurrent exceptions to the
     corresponding Python exceptions.
     """
-    original_convert_sql_exception = captured.convert_exception
+    original_convert_sql_exception = captured._convert_exception
 
     def convert_delta_exception(e: "JavaObject") -> CapturedException:
         delta_exception = _convert_delta_exception(e)