Improve log cleanup script and enhance error handling

[mnott]

• Rewrite log cleanup script for better efficiency and safety
• Enhance error handling and reporting in cleanup process
• Implement final cleanup task to ensure script removal

Changes in airflow-log-cleanup-pwdless-ssh.py:

• Updated log_cleanup script:

  • Use bash heredoc for improved readability
  • Implement more robust file processing with while loop
  • Add error handling for file operations
  • Include removal of empty directories

• Modified create_log_cleanup_script task:

  • Use heredoc for script creation
  • Improve host detection and script distribution

• Refactored cleanup tasks:

  • Enhanced error checking for script existence
  • Improved SSH command execution and error handling
  • Added return value checking for cleanup operations

• Added final_cleanup task:

  • Ensures removal of temporary cleanup script
  • Uses bash -c to avoid template issues

• Updated task dependencies:

  • All cleanup tasks now feed into final_cleanup task

These changes improve the overall reliability and efficiency of the log cleanup process, while also enhancing error reporting and ensuring proper cleanup of temporary files.