Skip to content

Latest commit

 

History

History
18 lines (15 loc) · 472 Bytes

File metadata and controls

18 lines (15 loc) · 472 Bytes

03 – Sequence (Streaming)

sequenceDiagram
  participant Producer as Producer System
  participant PubSub as PubSub Topic
  participant DF as Dataflow Beam
  participant BQ as BigQuery
  participant CMP as Cloud Composer
  participant BI as Dashboards / Exports

  Producer->>PubSub: publish event
  PubSub->>DF: pull batch
  DF->>DF: validate, dedup, enrich
  DF->>BQ: write to raw
  CMP->>BQ: schedule transform raw->stage->mart
  BQ->>BI: serve reports

Loading