Currently, due to the use of MapDatastore, the entire file (io.Reader) passed to .BuildV1 is kept in memory. It would be nice if there was a way to specify that this should not happen. In those cases, I think using go-ds-flatfs as the datastore in a temp dir might be a good alternative, although I haven't tested it.
I might be able to make PR for this in the future.
Currently, due to the use of
MapDatastore, the entire file (io.Reader) passed to.BuildV1is kept in memory. It would be nice if there was a way to specify that this should not happen. In those cases, I think using go-ds-flatfs as the datastore in a temp dir might be a good alternative, although I haven't tested it.I might be able to make PR for this in the future.