[4.0][Spark] Fix metadata cleanup by retaining files required for log reconstruction#4784

vkorukanti merged 2 commits intodelta-io:branch-4.0delta-io/delta:branch-4.0from

felipepessoto:felipepessoto_fix_log_retention_4_0felipepessoto/delta:felipepessoto_fix_log_retention_4_0Copy head branch name to clipboard