S3 Support with Release 1.6.0

[wwaldner-amtelco]

Not sure if I am doing something wrong, but when I try and use the parquet-go/source/s3, I get an error when I try and get the package:
go get: module github.com/xitongsys/parquet-go@upgrade found (v1.6.0), but does not contain package github.com/xitongsys/parquet-go/source/s3

Has anyone successfully used the S3 module. I really need this in a project and would appreciate any help.

[saedx1]

I've not actually tried.
However, if you're intention is to write to s3; we've been writing parquet files to memory (with NewMemFileWriter) then uploading them to s3 from there.
This should be really easy :

1. Write File to Memory.
2. Read it back into a buffer/byte array using https://github.com/spf13/afero (that's what's actually used to write it).
3. Write the byte array to s3.

[wwaldner-amtelco]

Seems like if the s3 module was in a release, it would make things a lot easier. Looks like the code to implement a s3 writer is there, just not part of a release.