- 
                Notifications
    
You must be signed in to change notification settings  - Fork 16
 
feat: basic support for SQL SELECT -> ExtendedExpression #55
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
| 
           ACTION NEEDED Substrait follows the Conventional Commits The PR title and description are used as the merge commit message. Please update your PR title and description to match the specification.  | 
    
80738d1    to
    b70ef4e      
    Compare
  
    | 
           I just imported this from an experiment, it's far from being done. I need to refactor and further improve it. Here is a reference to the kind of operations I'm aiming at supporting: https://arrow.apache.org/docs/python/generated/pyarrow.dataset.Expression.html#pyarrow.dataset.Expression 
  | 
    
a727475    to
    3c9f6eb      
    Compare
  
    | 
           
  | 
    
| 
           The pyarrow pull request related to this one to execute queries on arrow datasets via ExtendedExpressions was merged, so I'll try to recover work on this one as soon as I can  | 
    
This allows to compile basic SQL SELECT statements to ExtendedExpressions,
the goal is to handle pyarrow Dataset support for ExtendedExpressions
in Projections and Filtering of Datasets.
This can act as a starting for future support of more advanced features,
like subqueries and entire Substrait Plans,
for the moment the goal is just to support what pyarrow.Expressions
can represent