Skip to content

[Feature Request]: Support ProcessingTime Timer in Spark Runner #33633

Open
@twosom

Description

@twosom

What would you like to happen?

I would like to implement ProcessingTime timer support in the Spark Runner.

The main motivation for this request is that tracking event time in RDD-based Spark Runner's real-time streaming pipelines is currently challenging(see #23129). Therefore, we need to implement ProcessingTime timer first.

Issue Priority

Priority: 2 (default / most feature requests should be filed as P2)

Issue Components

  • Component: Python SDK
  • Component: Java SDK
  • Component: Go SDK
  • Component: Typescript SDK
  • Component: IO connector
  • Component: Beam YAML
  • Component: Beam examples
  • Component: Beam playground
  • Component: Beam katas
  • Component: Website
  • Component: Infrastructure
  • Component: Spark Runner
  • Component: Flink Runner
  • Component: Samza Runner
  • Component: Twister2 Runner
  • Component: Hazelcast Jet Runner
  • Component: Google Cloud Dataflow Runner

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions