feat: multi-chain operators #49
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
nhtyy
force-pushed
the
n/consolidate
branch
2 times, most recently
from
7b953fd to
04a611e
Compare
There was a problem hiding this comment.
This PR so far consolidates all of the operators into a single one, which is good for reducing infra cost.
To reduce proving cost, we should also share proofs when we can (which is the happy path, as all the deployments for the same chain should be synced).
We should:
- Check the latest blocks across all deployments.
- Spawn thread for each proof for each latest contract block. The endBlock should be the same across all of them.
- Relay in separate threads.
There was a problem hiding this comment.
MultichainOperator takes in a HashMap of chain id -> provider.
There was a problem hiding this comment.
@ratankaliani regarding this comment--what happens when the chains are not synced? We cannot rely on solely the happy path.
There was a problem hiding this comment.
Threads are spawned for each unique proof that needs to be generated.
Co-authored-by: Ratan Kaliani <[email protected]>
Co-authored-by: Ratan Kaliani <[email protected]>
Co-authored-by: Ratan Kaliani <[email protected]>
This reverts commit c4eacbf.
* chore: help refactor * add * add
nhtyy
added a commit
that referenced
this pull request
Feb 18, 2025
* chore: cleanup api / util seperation * chore: add retries to some tendermint routes * fix: dont need option on sleep duration * feat: multi-chain operator * log -> tracing * fix: cleanup * separate logs * feat: batch proofs * fix: log chain id on fail * temp: prints * cleanup * comments, default env filter * fix: use old env setup for one chain * update example env * Update script/src/util/retry.rs Co-authored-by: Ratan Kaliani <[email protected]> * fix: move consensus checks of target block to `run_inner` * Update script/bin/operator.rs Co-authored-by: Ratan Kaliani <[email protected]> * fix: remove `we` from comments * fix: new fn for vkey/data commit max checks * add section headings in operator, use_kms -> signer mode * missed `we` * fix: use_kms_relayer -> signer_mode * run -> loop Co-authored-by: Ratan Kaliani <[email protected]> * Revert "run -> loop" This reverts commit c4eacbf. * chore: simplify operator loop, renaming, better comments (#50) * chore: help refactor * add * add * chore: arc networkprover * chore: docs * docs * chore: fmt * rm unused clones & arc --------- Co-authored-by: Ratan Kaliani <[email protected]>
nhtyy
added a commit
that referenced
this pull request
Feb 19, 2025
* fix: chunk header requests * fix: exponential backoff on failed requests * fix: comment * fix: add log for failures * chore: add catch unwind on Operator::run * add errs to tendermint utils * fix: better worst case handling * fix: dont max out rate limit in loop * fix: retry faster on errors * fix: cleanup more unwraps, debug print err * feat: multi-chain operators (#49) * chore: cleanup api / util seperation * chore: add retries to some tendermint routes * fix: dont need option on sleep duration * feat: multi-chain operator * log -> tracing * fix: cleanup * separate logs * feat: batch proofs * fix: log chain id on fail * temp: prints * cleanup * comments, default env filter * fix: use old env setup for one chain * update example env * Update script/src/util/retry.rs Co-authored-by: Ratan Kaliani <[email protected]> * fix: move consensus checks of target block to `run_inner` * Update script/bin/operator.rs Co-authored-by: Ratan Kaliani <[email protected]> * fix: remove `we` from comments * fix: new fn for vkey/data commit max checks * add section headings in operator, use_kms -> signer mode * missed `we` * fix: use_kms_relayer -> signer_mode * run -> loop Co-authored-by: Ratan Kaliani <[email protected]> * Revert "run -> loop" This reverts commit c4eacbf. * chore: simplify operator loop, renaming, better comments (#50) * chore: help refactor * add * add * chore: arc networkprover * chore: docs * docs * chore: fmt * rm unused clones & arc --------- Co-authored-by: Ratan Kaliani <[email protected]> * fix: network prover run -> run_async * fix: clippy --------- Co-authored-by: Ratan Kaliani <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR introduces changes to the binary to support multiple instances of
Operator, as well as logically separatesutilsfrom "low level" tendermint rpc calls.