Skip to content

Conversation

@sirosen
Copy link
Member

@sirosen sirosen commented Nov 20, 2025

This is an initial experimental implementation, not necessarily our long-term interface.
It solves the most important problem in handling HTTPS for GCS, which is translating a file URL into a collection ID.

The interface is the part most subject to potential future refinement, as it's not clear how to provide the right level of control over

  • the transport used to sniff details
  • the transfer client used to lookup by ID
  • the client and transport used to actually do the download

This is an implementation of HTTPS download from GCS collections via
Location header sniffing, which is the only mechanism we have available
on all GCS versions for translating a URL to a client ID.

This is an implementation of HTTPS download from GCS collections via
Location header sniffing, which is the only mechanism we have available
on all GCS versions for translating a URL to a client ID.
@sirosen sirosen force-pushed the experimental-gcs-downloader branch from e991f07 to 2fa56e4 Compare November 20, 2025 15:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant