Skip to content

Conversation

@wilwade
Copy link

@wilwade wilwade commented Aug 19, 2025

Problem

Buffers were not correctly being compared causing incorrect statistics.

Closes #137

Solution

Added buffer comparison separately from other > / < for statistics.

Change summary:

Steps to Verify:

  1. See the test!

@wilwade wilwade requested a review from shannonwells August 19, 2025 21:15
@wilwade wilwade force-pushed the fix/metadata-buffer-comp-137 branch from 73015a5 to b806f0d Compare August 20, 2025 13:28
@wilwade wilwade enabled auto-merge (squash) August 20, 2025 13:32
Copy link

@shannonwells shannonwells left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I reviewed the code and added a test, and added Date type to the comparator. Looks good to go.

throw new Error('Unsupported time unit');
}

export function isUint8Array(x: unknown): x is Uint8Array {

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

x is Uint8Array

TIL

@wilwade wilwade merged commit a0bf345 into main Aug 21, 2025
4 checks passed
@wilwade wilwade deleted the fix/metadata-buffer-comp-137 branch August 21, 2025 13:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Parquet metadata written can be corrupt due to Buffer comparison for DECIMAL type

3 participants