Open
Description
Is your feature request related to a problem?
In Sanity the Testing, we only test for the JSON format data, and each query will scan 1045 JSON files, that is the primary slowness during Spark execution (~90% time spent on file scan). Can parquet file format be able to use? It could be much and much faster. We didn't test other data format cases.
What solution would you like?
Not sure it is supported or not. Close it if this is already supported.
What alternatives have you considered?
A clear and concise description of any alternative solutions or features you've considered.
Do you have any additional context?
Add any other context or screenshots about the feature request here.
Metadata
Metadata
Assignees
Type
Projects
Status
Design