-
Notifications
You must be signed in to change notification settings - Fork 778
feat: support load/select parquet files into a single variant column. #18028
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
7402440
to
bba3c46
Compare
50a10a3
to
eb51071
Compare
tests/sqllogictests/suites/stage/formats/parquet/parquet_to_variant.test
Show resolved
Hide resolved
so What if the parquet has only one column? |
yes
the same:map parquet root record to a variant object |
this failure in ci seems not related to this pr
cc @dantengsky |
src/query/storages/parquet/src/parquet_variant_table/parquet_to_variant.rs
Outdated
Show resolved
Hide resolved
@youngsofun Thanks for letting me know it, fixed (and merged) in #18038 |
c3a5556
to
eaf1a4d
Compare
I hereby agree to the terms of the CLA available at: https://docs.databend.com/dev/policies/cla/
Summary
example
arrow types not supported:Timestamp with timezone,Decimal with neg scale,Time32,Time64, Map with non-str key
Tests
Type of change
This change is