Skip to content

WB upload speedup needed #7577

@acwhite211

Description

@acwhite211

A speedup to the workbench upload is needed for large datasets. This is especially needed in order to speedup the process of data conversions. A possible solution might be to try batching the database operations for uploading each of the workbench rows into actual database records. This would decrease the amount of database request are made by Django and also hopefully be more efficient on the database side as well. This solution also applies to speeding up the workbench validation.

The goal is for the workbench validation and uploads to complete in a few minutes, as opposed to the hours that is can take on large datasets.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions