- 
                Notifications
    
You must be signed in to change notification settings  - Fork 247
 
Fix: Fix null handling in CometVector implementations #2643
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
          Codecov Report❌ Patch coverage is  Additional details and impacted files@@             Coverage Diff              @@
##               main    #2643      +/-   ##
============================================
+ Coverage     56.12%   59.25%   +3.12%     
- Complexity      976     1449     +473     
============================================
  Files           119      147      +28     
  Lines         11743    13761    +2018     
  Branches       2251     2367     +116     
============================================
+ Hits           6591     8154    +1563     
- Misses         4012     4383     +371     
- Partials       1140     1224      +84     ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
  | 
    
CometPlainVector#getBinary
      | 
           
  | 
    
          
 Yes, I completely agree that unnecessary null checking should be avoided for performance reasons. 
 For   | 
    
| 
           The failing unit tests appear to be related to the   | 
    
          
 I stand corrected. This does make the implementations consistent with Spark.  | 
    
| // | ||
| // This code is also based on the implementation of the array_insert from the Apache Spark | ||
| // https://github.com/apache/spark/blob/branch-3.5/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala#L4713 | ||
| // Implementation aligned with Arrow's half-open offset ranges and Spark semantics. | 
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The version fixed by ChatGPT :)
CometPlainVector#getBinary
Which issue does this PR close?
Closes #2612.
Rationale for this change
What changes are included in this PR?
How are these changes tested?
Added UT.