Skip to content

[Data] Clean up read release tests #65919

Description

@yuhuan130

Description

Clean up the existing Ray Data read release tests.

  • #ISSUE Move read tests to 4 m5.24xlarge workers.
  • #ISSUE Add a network bandwidth assertion.
  • #ISSUE Add a read-task heap memory assertion.
  • #ISSUE Set timeouts based on dataset size.
  • #ISSUE Add an ImageNet read_iceberg release test.

We plan to complete these items in separate, focused PRs.

Use case

This should make the read benchmarks less flaky and help catch network, memory, and performance regressions.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions