Skip to content

[Feature Request] - Handle multiple parquet hived partition as an input dataset #249

@lbesnard

Description

@lbesnard

Summary

Handle multiple parquet hived partition as an input dataset


Problem / Motivation

AMSA vessel data from @khannakarishma is converted to yearly Parquet files.

The CO library can't handle this at the moment

Proposed Solution

  • Modify the parquet handler to handle it

Further info

  • @khannakarishma to provide test Parquet dataset, link to an S3 location is enough

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions