Skip to content

Conversation

@tarasmadan
Copy link
Collaborator

The problem is the deadlock happening on GCS storage error.

GCS client establishes the connection when it has enough data to write. It is approximately 16M.
The error happens on io.Writer access in the middle of the merge.
This error terminates errgroup goroutine. Other goroutines remain blocked.
This commit propagates termination signal to other goroutines.

@tarasmadan tarasmadan force-pushed the fix_bucket_error_processing branch from c205fe2 to 43e7359 Compare December 19, 2024 20:06
@tarasmadan tarasmadan marked this pull request as ready for review December 19, 2024 20:06
The problem is the deadlock happening on GCS storage error.
GCS client establishes the connection when it has enough data to write.
It is approximately 16M. The error happens on io.Writer access in the middle of the merge.
This error terminates errgroup goroutine. Other goroutines remain blocked.
This commit propagates termination signal to other goroutines.
@tarasmadan tarasmadan force-pushed the fix_bucket_error_processing branch from 43e7359 to b0ff8f9 Compare December 19, 2024 20:15
@tarasmadan tarasmadan added this pull request to the merge queue Dec 19, 2024
Merged via the queue into google:master with commit 0f61b41 Dec 19, 2024
17 checks passed
@tarasmadan tarasmadan deleted the fix_bucket_error_processing branch December 21, 2024 14:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants