Skip to content

Conversation

@bkontur
Copy link
Collaborator

@bkontur bkontur commented Jan 29, 2026

Summary

This PR improves the integration testing infrastructure with better IPFS connectivity, parameterized tests, unified logging, and detailed storage statistics.

Key changes:

  • IPFS port configuration: Custom ports (4011, 5011, 8283) to avoid conflicts with other IPFS instances; separate API vs Gateway URL handling
  • IPFS isolated mode: Container starts with DHT routing, mDNS discovery, and relay disabled for reproducible tests
  • Improved peer reconnection: Scripts now check peer ID only (not full multiaddr) and use WebSocket transport (tcp/PORT/ws) for reliable connectivity
  • Parameterized tests: store_big_data.js accepts image_size parameter (small, big32, big64, big96) from CLI/CI
  • Storage statistics: New detailed output showing per-block transaction counts, timestamps, throughput, and visual bars

@bkontur bkontur changed the base branch from main to parametrise_tests January 30, 2026 00:32
@bkontur bkontur changed the title [Test] Increased tx pool from 20->40 MiB More nits Jan 30, 2026
@bkontur bkontur merged commit 37544c2 into parametrise_tests Jan 30, 2026
5 checks passed
@bkontur bkontur deleted the parametrise_tests2 branch January 30, 2026 00:35
bkontur added a commit that referenced this pull request Jan 30, 2026
* WIP parametrisation

* fix

* fix timeout

* Fix destructuring of store() return value in native_ipfs_dag_pb_chunked_data.js

The store() function now returns { cid, blockHash, blockNumber } instead of
just the CID. Update the destructuring to extract the cid property correctly.

Co-Authored-By: Claude Opus 4.5 <[email protected]>

* Add per-block transaction breakdown to storage statistics

Replace the simple "Number of blocks" metric with a detailed breakdown
showing the transaction count for each block in the measured range,
including a visual bar chart for quick distribution analysis.

Co-Authored-By: Claude Opus 4.5 <[email protected]>

* Move start right before storing

* Add start/end block

* Let use 12->18 signers inparallel

* Extract NUM_SIGNERS constant for parallel workers

Replace hardcoded value with configurable constant set to 16.

Co-Authored-By: Claude Opus 4.5 <[email protected]>

* parametrised all the examples

* unified JS logging and justfile echoing

* moved logging into a separate file

* revert

* added missing parameter

* fix(examples): calculate block stats from actual transaction blocks

Calculate startBlock and endBlock from the first and last blocks where
transactions were actually included, rather than querying the current
block number at start/end times.

Also show all blocks (including empty ones) in the TRANSACTIONS PER BLOCK
section, displaying 0 txs for blocks without transactions.

Co-Authored-By: Claude Opus 4.5 <[email protected]>

* 32MiB -> 64MiB

* fix(examples): use TX_MODE_FINALIZED_BLOCK for authorization calls

Wait for finalized blocks in authorizePreimage and authorizeAccount
calls to ensure authorization is complete before proceeding with store.

Co-Authored-By: Claude Opus 4.5 <[email protected]>

* fix big_data ipfs naming

* renamed justfile too

* added live westend and paseo setups in just, fixed bug in api.js (full size would not pass)

* More nits (#209)

* Increased tx pool from 20->40 MiB

* WIP: try without `--network host`

* WIP: big32 back

* Wait finalized

* Revert

* Try 30MiB

* WIP: wrong ip causes disconnects?

* Fix docker ipfs ips

* nit

* revert back to host network with 127.0.0.1

* Run first

* Why this is doing difference for Kubo?

* Log connected peers

* Disabled IPFS dht and discovery

* less logs

* WIP: temporary cache to speed to

* wip

* Removed `ws` ?

* Fix listen-addr

* nit

* Better IPFS?

* Nit

* One more nit

* omfg

* Refactor DEFAULT_HTTP_IPFS_API and custom ports

* Nit

* Very nit

* Refactor

* Revert

* Change pool

* fmt + revert back to ws

* Restart IPFS?

* big96

* Parametrize image size

* Stats

* REvert

* Removed comment

* Last nits

---------

Co-authored-by: Branislav Kontur <[email protected]>
Co-authored-by: Claude Opus 4.5 <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants