Draft
Conversation
* Create scripts to batch single txs * Create scripts to register dust and fund initial accounts * Create scripts to submit single txs round robin * Send txs to all relays round robin * Fix total sum of wallets funded * Remove randomness from funding * Detect max threads of machine * Generate txs stored in file * Copy toolkit.db to each thread and execute in parallel * Spread calls to all nodes for get balances * Removed batch_txs.py * Add multi threaded multi funding seed support Expose start-end seed command line argument Log sent time vs finalization time for send batch txs Signed-off-by: chrispalaskas <[email protected]> * Store txs in bytes not json Add start end arguments for send batch txs Signed-off-by: chrispalaskas <[email protected]> * Add a random small delay between RPC call submissions Add max worker argument to throttle down txs submission New script that counts distinct txs found in logs Signed-off-by: chrispalaskas <[email protected]> --------- Signed-off-by: chrispalaskas <[email protected]> Co-authored-by: chrispalaskas <[email protected]>
* performance-testing/memepool benchmark reporting * update benchmark script
…utput-hk/partner-chains into performance-benchmarking
…utput-hk/partner-chains into performance-benchmarking
Signed-off-by: chrispalaskas <[email protected]>
Signed-off-by: chrispalaskas <[email protected]>
Add tx counter ipynb
…utput-hk/partner-chains into performance-benchmarking # Conflicts: # e2e-tests/.gitignore
…rts for both charlie and ferdie
Add --indices for list instead of range argument
Add a get dust balances Add list of indices for register/fund
…utput-hk/partner-chains into performance-benchmarking
* Add binary applier script * Fix log message * Make sure MN_DONT_WATCH_PROGRESS is deleted so we don't send unwatched txs on some scripts * Rename arguments Add funding indices argument * Add start end indices for send_batch_txs * Add batches with delay for send_batch_txs * Default batching mode to 0 * Add shortcut args * Add logging to send_batch Signed-off-by: chrispalaskas <[email protected]> * Fix tps for jupyter * Small fixes on jupyter * Night amount not required for registering dust * Fix log message per script type for binary applier * New script to register and fund at the same time per batch * Add uniform random delay register and fund Add logging to binary applier script * default log file * Add fetch between batches and 12 sec sleep * NIGHT_AMOUNT optional, def 1000000 * Add check initial balances * Check balances before funding in fund_wallets * Check for RPC errors fund wallets Check for dust balance before registering * check for dust as well before funding * Remove binary-applier (replaced by register_and_fund) * verbose logging for logger * Short arg for start end * Pad print log amount for 4 digits seed * Left align total balance logs * Add retries for RPC calls * 50% of threads * Add uniform delay to get night/dust script as well * rotate relays when failing --------- Signed-off-by: chrispalaskas <[email protected]>
…ports from memory
* Add streaming of logs from other scripts to binary applier script * Uniform cmd line arguments across all scripts * Fix typo * Allow indices vs ranges for binary operation (non consecutive) * Add indices args to binary applier script * Format indices for non consecutive case * Add new line on print * add shortcut for dest indices * test aura logs * fix duplicate jupyter script * log total execution time * Add analyze prometheus metrics script Add localhost support * Add plot for tx processing time to prometheus metrics * REmove execution cell data --------- Co-authored-by: chrispalaskas <[email protected]>
* Add streaming of logs from other scripts to binary applier script * Uniform cmd line arguments across all scripts * Fix typo * Allow indices vs ranges for binary operation (non consecutive) * Add indices args to binary applier script * Format indices for non consecutive case * Add new line on print * add shortcut for dest indices * test aura logs * fix duplicate jupyter script * log total execution time * Add analyze prometheus metrics script Add localhost support * Add plot for tx processing time to prometheus metrics * REmove execution cell data --------- Co-authored-by: chrispalaskas <[email protected]>
* benchmarking: fix memepool scripts * benchmarking: refactor notebook * benchmarking: fixed memepool section * benchmarking: finish refactor * Performance/add contract calls load (#1146) * Performance/improve scripts 2 (#1142) * Add streaming of logs from other scripts to binary applier script * Uniform cmd line arguments across all scripts * Fix typo * Allow indices vs ranges for binary operation (non consecutive) * Add indices args to binary applier script * Format indices for non consecutive case * Add new line on print * add shortcut for dest indices * test aura logs * fix duplicate jupyter script * log total execution time * Add analyze prometheus metrics script Add localhost support * Add plot for tx processing time to prometheus metrics * REmove execution cell data --------- Co-authored-by: chrispalaskas <[email protected]> * Performance/improve scripts 3 (#1143) * Add streaming of logs from other scripts to binary applier script * Uniform cmd line arguments across all scripts * Fix typo * Allow indices vs ranges for binary operation (non consecutive) * Add indices args to binary applier script * Format indices for non consecutive case * Add new line on print * add shortcut for dest indices * test aura logs * fix duplicate jupyter script * log total execution time * Add analyze prometheus metrics script Add localhost support * Add plot for tx processing time to prometheus metrics * REmove execution cell data --------- Co-authored-by: chrispalaskas <[email protected]> * Add contract call script * Add contract specific files for testing * Deploy simple contract script * Add contract deploy and call scripts * Add script tx load applier for soaking * Add seed end to script * Typo fix and add README * Revert latest change * log total time of execution * Capture total successful txs submitted * remove compact generated files * Remove analyze_tx_logs notebook from feature branch --------- Co-authored-by: chrispalaskas <[email protected]> * benchmarking: fix memepool scripts * benchmarking: refactor notebook * benchmarking: fixed memepool section * benchmarking: finish refactor * benchmarking: refactor performance analysis notebook * added an id to the markdown cells so we can export to pdf renamed NODES variable for comprehension * Fix pattern to match new logs --------- Co-authored-by: Christos Palaskas <[email protected]> Co-authored-by: chrispalaskas <[email protected]>
* benchmarking: refactor notebook * benchmarking: fixed memepool section * benchmarking: finish refactor * benchmarking: refactor performance analysis notebook * benchmarking: refactor notebook * benchmarking: fixed memepool section * benchmarking: finish refactor * added an id to the markdown cells so we can export to pdf renamed NODES variable for comprehension * Fix pattern to match new logs * add some prometheus analysis * multi thread tx load applier, so I can read logs in real time * Unbuffered streaming of logs * Minor fixes on jupyter * Add number of failed seeds * restore rebase lost code --------- Co-authored-by: ladamesny <[email protected]> Co-authored-by: chrispalaskas <[email protected]>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Add your description here, if it fixes a particular issue please provide a
link
to the issue.
Checklist
changelog.mdfor affected crate