Skip to content

Conversation

@yzeng1618
Copy link
Contributor

#10301

Purpose of this pull request

This PR adds optional min_timestamp / max_timestamp options to HBaseSource and applies them to HBase Scan#setTimeRange so users can scan data within a timestamp window. It also updates docs and adds unit/E2E tests.

Does this PR introduce any user-facing change?

Yes. New optional source options min_timestamp and max_timestamp (epoch milliseconds, [min, max)) allow time-range scans by cell timestamp in HBaseSource. Docs are updated to describe the new options.

How was this patch tested?

Added unit tests:

  • HbaseClientTest for time-range scan behavior
  • HbaseParametersTest for config parsing
  • Added E2E test:
    • HbaseIT.testHbaseSourceWithTimeRange with HBase API timestamped puts + assert on time-range scan

Check list

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants