[Data] Improve Progress Bar Display in Non-Interactive Terminals

[daiping8]

Description

I followed the guidance in #57734 to use logging instead of progress bars for non-interactive terminals.

Option 1: Auto-detect non-interactive terminals and disable progress bars entirely
Option 3: Use a simpler logging-based approach for non-interactive terminals (e.g., "Completed 50/100 tasks")

Specifically:

• Disable progress bar display in non-interactive terminals
• Implement progress output in the form of logs in non-interactive terminals
• Add configuration for the interval time of progress log output
• Optimize the update logic of the progress bar to support cases with unknown total counts
• Related test cases

Verification

This can be verified by the following test case.

import ray
import time
import numpy as np

def create_test_data():
    data = []
    for i in range(1000):
        data.append({
            "id": i,
            "value": np.random.rand(),
            "category": f"category_{i % 10}"
        })
    return data

def slow_processing_function(batch):
    time.sleep(0.01)
    batch["processed_value"] = batch["value"] * 2
    batch["is_even"] = batch["id"] % 2 == 0
    return batch

def main():
    ray.init(num_cpus=4)
    
    from ray.data.context import DataContext
    ctx = DataContext.get_current()
    ctx.enable_progress_bars = False
    
    try:
        test_data = create_test_data()
        ds = ray.data.from_items(test_data)
        processed_ds = ds.map(slow_processing_function)
        filtered_ds = processed_ds.filter(lambda x: x["id"] % 5 == 0)
        grouped_result = filtered_ds.groupby("category").count()      
        result = grouped_result.take_all()      
        # Show first 5 results
        for item in result[:5]:
            print(f"  {item}")    
        print(processed_ds.stats())        
    finally:
        ray.shutdown()


if __name__ == "__main__":
    main()

In the interactive terminal:

In the non-interactive terminal:

Related issues

Closes #57734

[gemini-code-assist]

Code Review

This pull request effectively improves the progress bar display for non-interactive terminals by switching to a logging-based approach. The changes are well-structured, covering the core logic, configuration, and corresponding tests. My review includes a few suggestions to enhance code clarity and maintainability by simplifying logical conditions and reducing code duplication in the tests.