Commit c0a6193

committed

Implement scheduler using kafka

The producer module produces events on kafka for each pending job. The consumer modules consume events and books jobs on host, still relying on the database.

1 parent 378dde3 commit c0a6193Copy full SHA for c0a6193

37 files changed

+1751

-863

lines changed

rust
- .gitignore
- Cargo.lock
- Cargo.toml
- config
- crates
  - job-queue/src
    - consumer
    - models.rs
  - scheduler
    - Cargo.toml
    - src
      - config
        error.rs
        mod.rs
      - dao
        frame_dao.rs
        host_dao.rs
        job_dao.rs
        layer_dao.rs
        mod.rs
      - job_dispatcher
        dispatcher.rs
        error.rs
        event_handler.rs
        frame_set.rs
        job_consumer.rs
        mod.rs
      - job_fetcher
        job_producer.rs
        mod.rs
      - main.rs
      - models
        core_size.rs
        frame.rs
        host.rs
        job.rs
        layer.rs
        mod.rs
        virtual_proc.rs
      - pgpool.rs

37 files changed

+1751

-863

lines changed

`‎rust/.gitignore‎`

-Original file line number
+Diff line change
 # TODO: Remove once these crates are stable and ready for public use
 /crates/cuebot-config
 /crates/dist-lock
 -/crates/scheduler
 .DS_Store
 config/rqd.local_docker.yaml

Comments

(0)