Skip to content

feat: Ray-Rust integration for distributed proving#13

Merged
mascharkh merged 2 commits intomainfrom
feat/ray-rust-integration
Dec 31, 2025
Merged

feat: Ray-Rust integration for distributed proving#13
mascharkh merged 2 commits intomainfrom
feat/ray-rust-integration

Conversation

@mascharkh
Copy link
Member

Closes #9

Summary

Connects Python Ray workers to Rust proof generation via CLI binary.

Changes

  • Add prove_chunk CLI binary (zkml/src/bin/prove_chunk.rs)
  • Add Python wrapper (python/rust_prover.py)
  • Update tests/simple_distributed.py with real prover support
  • Add clap and hex dependencies

Before

Ray workers used placeholder proof generation (simulation only).

After

Ray workers generate real ZK proofs via Rust prover:

  • Simulation mode: parallel, instant
  • Real mode: sequential, ~2-3s per chunk

Tests

  • Local CI: passed
  • Rust tests: 9/9 passed
  • simple_distributed.py --real --workers 2: both chunks succeed

Known limitations

masoud@anyscale.com added 2 commits December 31, 2025 11:41
- Add prove_chunk CLI binary (zkml/src/bin/prove_chunk.rs)
- Add Python wrapper (python/rust_prover.py)
- Update simple_distributed.py with real prover support
- Add clap and hex dependencies

Refs #9, #12
@mascharkh mascharkh merged commit 122da2b into main Dec 31, 2025
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

feat: Ray-Rust integration for distributed proving

1 participant