Not able to export large amount of db data (in crores) into a CSV file #33292
Unanswered
Bhav2308
asked this question in
Q&A / Help
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I am using Superset v4.1.2 (deployed via helm in Kubernetes).
I am trying to export a large amount of database data into a CSV file. The dataset contains around 20 million rows.
While viewing the charts, I see an option to export to CSV, but it allows a maximum of only 50,000 rows. This works fine and successfully generates a CSV file with 50,000 rows.
Another option is to use pagination, where I see 200 rows per page and a total of 50,000 pages, which confirms the dataset contains around 20 million rows. However, the drawback is that when downloading to CSV from the paginated view, it only exports the current 200 rows.
Is there any way to increase this download limit to 20 million rows (from 50k) and export the entire dataset (of 20 million rows) to a CSV file?
Beta Was this translation helpful? Give feedback.
All reactions