Skip to content

sync with open source how - #118

Draft
lesterhaynes wants to merge 10000 commits into
linkedin:li_trunkfrom
apache:master
Draft

lesterhaynes wants to merge 10000 commits into
linkedin:li_trunkfrom
apache:master

Conversation

@lesterhaynes

Copy link
Copy Markdown

Please add a meaningful description for your change here


Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

  • Mention the appropriate issue in your description (for example: addresses #123), if applicable. This will automatically add a link to the pull request in the issue. If you would like the issue to automatically close on merging the pull request, comment fixes #<ISSUE NUMBER> instead.
  • Update CHANGES.md with noteworthy changes.
  • If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

To check the build health, please visit https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md

GitHub Actions Tests Status (on master branch)

Build python source distribution and wheels
Python tests
Java tests
Go tests

See CI.md for more information about GitHub Actions CI.

Jack McCluskey and others added 30 commits September 30, 2026 13:50
* Fix partial insertError metric status bug

* Update bigquery_tools.py

streamline comment
…ns (#40358)

- Set `cache-read-only` in `setup-environment-action` unless triggered by `push`, `schedule`, or a workflow rerun (`run_attempt > 1`).

- Restrict remote Gradle build cache (`beam-cache.apache.org`) pushes to `push` and `schedule` events.

- Re-enable Gradle cache in `beam_PreCommit_Java` and `beam_PreCommit_Java_Dataflow` workflows.
Bumps [@grpc/grpc-js](https://github.com/grpc/grpc-node) from 1.14.4 to 1.14.5.
- [Release notes](https://github.com/grpc/grpc-node/releases)
- [Commits](https://github.com/grpc/grpc-node/compare/@grpc/grpc-js@1.14.4...@grpc/grpc-js@1.14.5)

---
updated-dependencies:
- dependency-name: "@grpc/grpc-js"
  dependency-version: 1.14.5
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
…40300)

EnumerationType (used for proto enum fields) wasn't handled in
IcebergUtils's Beam-to-Iceberg schema and row conversion. Writing a Row
with such a field threw "Unsupported Beam logical type Enum" while
deriving the table schema, and threw a ClassCastException converting
the row's value even against a pre-existing table.

Map EnumerationType to Iceberg's string type on write, the same way
Avro and BigQuery already convert it.

Fixes #40299
Improve ValidatesRunner performance. Parallelize runs
* [Go SDK] Close data and state channels on harness exit

* [Go SDK] Don't Recv on write after Send EOF

* [Go SDK] Treat canceled StateChannel reads as closed

* Document bugfix for Go harness issues

Fixed harness leaking Data/State gRPC streams and a deadlock issue.

* Fix empty critical section in tests

---------

Co-authored-by: Robert Burke <lostluck@users.noreply.github.com>
…commit

Remove allJavadoc from javaPreCommit
…ipeline (#40345)

- Port desiredNumUnboundedSourceSplits currently honored by Dataflow non-portable
  pipeline submission to Java portable (UnboundedSource translated to SDF wrapper)
  and Python SDK
Make Java PreSubmit faster: Parallelize test
* Port Wait.On to the Go SDK

* update exclusion comments
Add check_run fork guard to beam_PreCommit_Python_Dill.yml
Fix JaCoCo coverage for multiple test tasks.
…nner (#40302)

* Reduce logging severity for state requests cancelled by runner in Java Fn Harness
* Remove comment-based workflow run/rerun trigger functionality

* Remove redundant PR checkout step from setup-action
* Validate multi region biglake catalog

* trigger tests

* remove x-region test

* fix tests, cleanup test artifacts

* fixes

* rename
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.