Replies: 1 comment 4 replies
-
|
Hi, thank you for using OpenDAL. OpenDAL uses pagination internally; for example, with S3, it lists 1,000 entries per request. Would you like to share more details about this? Which service are you using? What pagination you expect? |
Beta Was this translation helpful? Give feedback.
4 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
In order to iterate over large number of files in a directory, it becomes challenging to handle large datasets efficiently. Does openDAL supports pagination or similar mechanism to make this efficient ?
Beta Was this translation helpful? Give feedback.
All reactions