Skip to content

Do not cache S3 ls results#22

Merged
mtaylorgds merged 1 commit into
mainfrom
acw-47/do-not-cache-s3-ls-results
Apr 30, 2026
Merged

Do not cache S3 ls results#22
mtaylorgds merged 1 commit into
mainfrom
acw-47/do-not-cache-s3-ls-results

Conversation

@mtaylorgds
Copy link
Copy Markdown
Contributor

@mtaylorgds mtaylorgds commented Apr 29, 2026

fsspec was caching the results of the ls operation when loading the list of available visualisations. This means that a user visiting the /visualisations page would not see the latest list of results. Update the usage of fsspsec so that the results are loaded fresh each time.

In a heavily used app, the caching could be useful, but during this proof-of-concept work it is not necessary and makes the app frustrating to use.

Jira ticket

fsspec was caching the results of the `ls` operation when loading the
 list of available visualisations. This means that a user visiting the
 `/visualisations` page would not see the latest list of results. Update
 the usage of fsspsec so that the results are loaded fresh each time.

In a heavily used app, the caching could be useful, but during this
 proof-of-concept work it is not necessary and makes the app frustrating
 to use.
@mtaylorgds mtaylorgds merged commit acb5c6a into main Apr 30, 2026
1 check passed
@mtaylorgds mtaylorgds deleted the acw-47/do-not-cache-s3-ls-results branch April 30, 2026 07:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants