Skip to content
This repository was archived by the owner on Sep 28, 2022. It is now read-only.

Batch csv #130

Open
wants to merge 41 commits into
base: master
Choose a base branch
from
Open

Batch csv #130

wants to merge 41 commits into from

Conversation

jaffee
Copy link
Member

@jaffee jaffee commented Sep 6, 2019

add picsv command for importing CSV data using the experimental batch ingestion interface

@jaffee jaffee requested a review from tgruben September 6, 2019 15:53
tgruben
tgruben previously approved these changes Sep 30, 2019
Copy link

@tgruben tgruben left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In general, looks good to me. I posted a few minor comments, but i think this is good for at least "beta" release. A lot to digest for critical review

return batch, pc, nil
}

func openFileOrURL(name string) (io.ReadCloser, error) {
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Its probably not worth the effort but,It would be nice if we provided a more generic storage interface to the various storage interfaces, kinda like https://github.com/kahing/goofys.


type SourceField struct {
// TargetField is the Pilosa field that this source field should map to.
TargetField string `json:"target-field"`
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Minor: TargetFieldName would provide a little clarity. For some reason Seeing SourceField and TargetField together in the code made me focus on the fact that those are not the same type. Or alternatively SourceFieldArgs?

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants