Hi there 👋
thanks for making this repo public!
I'd be interested in using it, however I would like it to have a few more additional features. Before filing a PR with the features implemented I believe it makes sense to double check whether that is actually wanted.
Features I have on my mind:
- parquet support (next to jsonl)
- s3 support to read+write payload directly from+to s3
- python bindings
Let me know what you think. Maybe just a subset of the above list is wished for datamap-rs.
Happy to discuss.