Bulk import data

[nshah14285]

Hello,
I have a CSV file whose size is 528MB and I would like to insert that data in the Sonic to test the performance.
I have tried using node app but it was taking a lot of time to import data.
Is there a way to import whole data at once without using the node app?

Thanks.

[valeriansaliou]

Hello! For now there’s not, unless you code your import utility in your favorite alternative language in something else than JS for Node.

…

-- Valerian Saliou CTO at Crisp

On 7 Aug 2019, at 8:07 AM, nshah14285 ***@***.***> wrote: Hello, I have a CSV file whose size is 528MB and I would like to insert that data in the Sonic to test the performance. Is there a way to import whole data at once without using the node app? Thanks. — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub, or mute the thread.

[nshah14285]

Is there a direct way to import into RocksDB with the correct sonic require format?

[valeriansaliou]

No, that's not going to work. As Sonic also needs to generate proper FSTs for the data you're importing.

[nshah14285]

OK Thanks.