ah-westend: Elastic Scaling with 3 cores on AssetHub Westend #9880

lexnv · 2025-09-30T12:00:22Z

This PR enables elastic scaling on AssetHubWestend with 3 bulk cores.

Guideline for enablement: https://paritytech.github.io/polkadot-sdk/master/polkadot_sdk_docs/guides/enable_elastic_scaling/index.html

Next Steps

Ensure collators are running with 2509 or newer
Double check the changes locally
If AH Westend looks good, we'll enable ES to AHPaseo

cc @paritytech/sdk-node @sandreim

Signed-off-by: Alexandru Vasile <[email protected]>

cumulus/parachains/runtimes/assets/asset-hub-westend/Cargo.toml

Signed-off-by: Alexandru Vasile <[email protected]>

polkadot/zombienet_tests/functional/0020-asset-hub-westend-elastic-scaling.toml

Signed-off-by: Alexandru Vasile <[email protected]>

…t > 1 Signed-off-by: Alexandru Vasile <[email protected]>

Signed-off-by: Alexandru Vasile <[email protected]>

sandreim · 2025-10-24T15:21:55Z

cumulus/pallets/parachain-system/src/lib.rs

 			let expected_rp_descendants_num = T::RelayParentOffset::get();

-			if expected_rp_descendants_num > 0 {
+			if expected_rp_descendants_num > 1 {


Why do we need this change ?

I've added this temporarly to filter out any testing issues, mostly all the asset-hub-westend-integration-tests were failing: https://github.com/paritytech/polkadot-sdk/actions/runs/18709940296/job/53356515320

I believe we need to add a few blocks of state to make this pass cleanly 🙏

Signed-off-by: Alexandru Vasile <[email protected]>

…westend

lexnv · 2025-11-10T13:27:57Z

This PR has been deployed on AHW around the time of the commit: 1038150

AHW lastRuntimeUpgrade:

{
  specVersion: 1,020,005
  specName: westmint
}

Investigating block production degradation in: #10227

The CI was randomly failing because it was missing:

sc-rpc-v2: Fix flaky tests #10211

…#10154) This PR adjusts the block authoring to stop producing blocks 1 second before the scheduled slot change. This introduces a safety buffer to prevent blocks from being authored too late for inclusion. - 2s blocks / 3 cores: The authoring duration of the last block is reduced from 2s to 1s. - 500ms blocks / 12 cores: The authoring duration cannot be reduced past 500ms, therefore the last two blocks are no longer authored ### Testing Done Tested on top of: - #9880 ### 3 cores 2s blocks ``` aura::cumulus: [Parachain] Adjusting authoring duration for slot. authoring_duration=2s duration=1.987s last_reported_slot=Some(Slot(293723040)) next_slot=Slot(293723040) next_duration_change=5.987s next_slot_change=Slot(293723041) aura::cumulus: [Parachain] Adjusted proposal duration. duration=Some(1.987s) aura::cumulus: [Parachain] Adjusting authoring duration for slot. authoring_duration=2s duration=1.991s last_reported_slot=Some(Slot(293723040)) next_slot=Slot(293723040) next_duration_change=3.991s next_slot_change=Slot(293723041) aura::cumulus: [Parachain] Adjusted proposal duration. duration=Some(1.991s) aura::cumulus: [Parachain] Adjusting authoring duration for slot. authoring_duration=2s duration=1.99s last_reported_slot=Some(Slot(293723040)) next_slot=Slot(293723041) next_duration_change=1.99s next_slot_change=Slot(293723041) aura::cumulus: [Parachain] Adjusted proposal duration. duration=Some(990ms) ``` ### 12 cores 500ms blocks ``` aura::cumulus: [Parachain] Adjusting authoring duration for slot. authoring_duration=2s duration=494ms last_reported_slot=Some(Slot(293724134)) next_slot=Slot(293724134) next_duration_change=1.494s next_slot_change=Slot(293724135) deadline=494ms aura::cumulus: [Parachain] Adjusted proposal duration. duration=Some(494ms) aura::cumulus: [Parachain] Adjusting authoring duration for slot. authoring_duration=2s duration=493ms last_reported_slot=Some(Slot(293724134)) next_slot=Slot(293724134) next_duration_change=993ms next_slot_change=Slot(293724135) deadline=0ns aura::cumulus: [Parachain] Not enough time left in the slot to adjust authoring duration. Skipping block production for the slot. next_duration_change=993ms next_slot_change=Slot(293724135) aura::cumulus: [Parachain] Adjusted proposal duration. duration=None aura::cumulus: [Parachain] Not building block due to insufficient authoring duration aura::cumulus: [Parachain] Adjusting authoring duration for slot. authoring_duration=2s duration=494ms last_reported_slot=Some(Slot(293724136)) next_slot=Slot(293724137) next_duration_change=494ms next_slot_change=Slot(293724137) deadline=0ns aura::cumulus: [Parachain] Not enough time left in the slot to adjust authoring duration. Skipping block production for the slot. next_duration_change=494ms next_slot_change=Slot(293724137) aura::cumulus: [Parachain] Adjusted proposal duration. duration=None aura::cumulus: [Parachain] Not building block due to insufficient authoring duration ``` Part of: #9848 --------- Signed-off-by: Alexandru Vasile <[email protected]> Co-authored-by: cmd[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: eduardspa <[email protected]> Co-authored-by: Sebastian Kunert <[email protected]> Co-authored-by: Andrei Sandu <[email protected]>

…#10154) This PR adjusts the block authoring to stop producing blocks 1 second before the scheduled slot change. This introduces a safety buffer to prevent blocks from being authored too late for inclusion. - 2s blocks / 3 cores: The authoring duration of the last block is reduced from 2s to 1s. - 500ms blocks / 12 cores: The authoring duration cannot be reduced past 500ms, therefore the last two blocks are no longer authored ### Testing Done Tested on top of: - #9880 ### 3 cores 2s blocks ``` aura::cumulus: [Parachain] Adjusting authoring duration for slot. authoring_duration=2s duration=1.987s last_reported_slot=Some(Slot(293723040)) next_slot=Slot(293723040) next_duration_change=5.987s next_slot_change=Slot(293723041) aura::cumulus: [Parachain] Adjusted proposal duration. duration=Some(1.987s) aura::cumulus: [Parachain] Adjusting authoring duration for slot. authoring_duration=2s duration=1.991s last_reported_slot=Some(Slot(293723040)) next_slot=Slot(293723040) next_duration_change=3.991s next_slot_change=Slot(293723041) aura::cumulus: [Parachain] Adjusted proposal duration. duration=Some(1.991s) aura::cumulus: [Parachain] Adjusting authoring duration for slot. authoring_duration=2s duration=1.99s last_reported_slot=Some(Slot(293723040)) next_slot=Slot(293723041) next_duration_change=1.99s next_slot_change=Slot(293723041) aura::cumulus: [Parachain] Adjusted proposal duration. duration=Some(990ms) ``` ### 12 cores 500ms blocks ``` aura::cumulus: [Parachain] Adjusting authoring duration for slot. authoring_duration=2s duration=494ms last_reported_slot=Some(Slot(293724134)) next_slot=Slot(293724134) next_duration_change=1.494s next_slot_change=Slot(293724135) deadline=494ms aura::cumulus: [Parachain] Adjusted proposal duration. duration=Some(494ms) aura::cumulus: [Parachain] Adjusting authoring duration for slot. authoring_duration=2s duration=493ms last_reported_slot=Some(Slot(293724134)) next_slot=Slot(293724134) next_duration_change=993ms next_slot_change=Slot(293724135) deadline=0ns aura::cumulus: [Parachain] Not enough time left in the slot to adjust authoring duration. Skipping block production for the slot. next_duration_change=993ms next_slot_change=Slot(293724135) aura::cumulus: [Parachain] Adjusted proposal duration. duration=None aura::cumulus: [Parachain] Not building block due to insufficient authoring duration aura::cumulus: [Parachain] Adjusting authoring duration for slot. authoring_duration=2s duration=494ms last_reported_slot=Some(Slot(293724136)) next_slot=Slot(293724137) next_duration_change=494ms next_slot_change=Slot(293724137) deadline=0ns aura::cumulus: [Parachain] Not enough time left in the slot to adjust authoring duration. Skipping block production for the slot. next_duration_change=494ms next_slot_change=Slot(293724137) aura::cumulus: [Parachain] Adjusted proposal duration. duration=None aura::cumulus: [Parachain] Not building block due to insufficient authoring duration ``` Part of: #9848 --------- Signed-off-by: Alexandru Vasile <[email protected]> Co-authored-by: cmd[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: eduardspa <[email protected]> Co-authored-by: Sebastian Kunert <[email protected]> Co-authored-by: Andrei Sandu <[email protected]> (cherry picked from commit 77c0125)

…ata (#10541) This PR ensures that the parachains test-utils crate has 2 relay parent descendants for testing purposes. Effectively fixes a panic because we missed this mock data for chains that started with `RP_offset > 0`: ``` Unable to verify provided relay parent descendants. expected_rp_descendants_num: 1 error: InvalidNumberOfDescendants { expected: 2, received: 0 } note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace ``` Detected in: - https://github.com/polkadot-fellows/runtimes/actions/runs/19857064730/job/56897622908?pr=1018 Unblocks: - polkadot-fellows/runtimes#1018 Inspired by a similar fix I've introduced in: - #9880 --------- Signed-off-by: Alexandru Vasile <[email protected]> Co-authored-by: cmd[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: Bastian Köcher <[email protected]>

…ata (#10541) This PR ensures that the parachains test-utils crate has 2 relay parent descendants for testing purposes. Effectively fixes a panic because we missed this mock data for chains that started with `RP_offset > 0`: ``` Unable to verify provided relay parent descendants. expected_rp_descendants_num: 1 error: InvalidNumberOfDescendants { expected: 2, received: 0 } note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace ``` Detected in: - https://github.com/polkadot-fellows/runtimes/actions/runs/19857064730/job/56897622908?pr=1018 Unblocks: - polkadot-fellows/runtimes#1018 Inspired by a similar fix I've introduced in: - #9880 --------- Signed-off-by: Alexandru Vasile <[email protected]> Co-authored-by: cmd[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: Bastian Köcher <[email protected]> (cherry picked from commit 0f28d81)

Signed-off-by: Alexandru Vasile <[email protected]>

lexnv · 2026-01-29T09:26:32Z

This PR has already deployed in the Westend as a runtime upgrade. We should merge it to align further deployments from origin/master (if not decommissioning Westend entirely)

pepoviola · 2026-01-29T15:56:56Z

/cmd fmt

pepoviola · 2026-01-30T14:34:04Z

ping @sandreim can we merge this one?

sandreim

A few things need to be addressed before merge.

cumulus/parachains/runtimes/assets/asset-hub-westend/src/lib.rs

cumulus/client/consensus/aura/src/collators/slot_based/slot_timer.rs

Co-authored-by: Andrei Sandu <[email protected]>

Signed-off-by: Alexandru Vasile <[email protected]>

paritytech-workflow-stopper · 2026-01-30T15:15:57Z

All GitHub workflows were cancelled due to failure one of the required jobs.
Failed workflow url: https://github.com/paritytech/polkadot-sdk/actions/runs/21519931456
Failed job name: run-frame-omni-bencher

lexnv · 2026-01-30T15:29:44Z

The run-frame-omni-bencher step is failing because the relay parent offset is not propagated to the mock data:

polkadot-sdk/substrate/utils/frame/benchmarking-cli/src/overhead/command.rs

Lines 215 to 218 in 0bb4f59

    
           let parachain_validation_data_provider = MockValidationDataInherentDataProvider::<()> { 
        
           	para_id: ParaId::from(*para_id), 
        
           	current_para_block_head: Some(header.encode().into()), 
        
           	relay_offset: 0,

This needs to be fixed before merging

data Signed-off-by: Alexandru Vasile <[email protected]>

lexnv added 4 commits September 30, 2025 11:51

ah-westend: Enable experimental-ump-signals feature for systems

04f534a

Signed-off-by: Alexandru Vasile <[email protected]>

ah-westend: Build into relay chain with offset of 1

84fb876

Signed-off-by: Alexandru Vasile <[email protected]>

ah-westend: Implement runtime api for parent offset

63f697b

Signed-off-by: Alexandru Vasile <[email protected]>

ah-westend: Elastic Scaling with 3 cores on AssetHub Westend

9f47d7e

Signed-off-by: Alexandru Vasile <[email protected]>

bkchr reviewed Sep 30, 2025

View reviewed changes

cumulus/parachains/runtimes/assets/asset-hub-westend/Cargo.toml Outdated Show resolved Hide resolved

lexnv added 2 commits October 7, 2025 15:38

zombinet/0020: Add asset hub westend with elastic scaling

3d53a69

Signed-off-by: Alexandru Vasile <[email protected]>

ci/tests: Double check 0020 panics in CI

0acde44

Signed-off-by: Alexandru Vasile <[email protected]>

lexnv requested review from a team as code owners October 7, 2025 15:55

lexnv added 5 commits October 7, 2025 16:01

ci: Add missing bracket

d7ea31c

Signed-off-by: Alexandru Vasile <[email protected]>

ci: Fix zombienet test

366fe39

Signed-off-by: Alexandru Vasile <[email protected]>

Merge remote-tracking branch 'origin/master' into lexnv/es-westend

369ca30

cargo: Remove experimental-ump-signals feature

3427c67

Signed-off-by: Alexandru Vasile <[email protected]>

Merge remote-tracking branch 'origin/master' into lexnv/es-westend

0035100

sandreim reviewed Oct 22, 2025

View reviewed changes

polkadot/zombienet_tests/functional/0020-asset-hub-westend-elastic-scaling.toml Outdated Show resolved Hide resolved

lexnv and others added 7 commits October 23, 2025 09:33

asset-hub-westend/genesis: Add dev stakers to enable zombinet tests

e795f16

Signed-off-by: Alexandru Vasile <[email protected]>

para_system: Temp fix check verify_relay_parent_descendants iff offse…

4f68c9d

…t > 1 Signed-off-by: Alexandru Vasile <[email protected]>

zombinet: Ensure ES works for AHWestend

5c437bd

Signed-off-by: Alexandru Vasile <[email protected]>

zombienet: Enable extra debug logs

bc8582f

Signed-off-by: Alexandru Vasile <[email protected]>

zombinet: Remove old 0020 elastic scaling test

4a49c97

Signed-off-by: Alexandru Vasile <[email protected]>

zombinet: Enable elastic_scaling_asset_hub_westend test

cf83236

Signed-off-by: Alexandru Vasile <[email protected]>

Merge branch 'master' into lexnv/es-westend

ca0d539

sandreim reviewed Oct 24, 2025

View reviewed changes

lexnv added 6 commits October 27, 2025 11:28

zombienet-sdk-helpers: Add more logs

e75164d

Signed-off-by: Alexandru Vasile <[email protected]>

tests: Increase validator count and add more scheduled cores

ffbd59a

Signed-off-by: Alexandru Vasile <[email protected]>

asset-hub-westend: Reduce block times to 1.5s from 2s

c412c96

Signed-off-by: Alexandru Vasile <[email protected]>

asset-hub-westend: Update test for 1.5s blocks

9b346a2

Signed-off-by: Alexandru Vasile <[email protected]>

Merge remote-tracking branch 'origin/lexnv/es-westend' into lexnv/es-…

5b7f32b

…westend

Merge remote-tracking branch 'origin/master' into lexnv/es-westend

361b35e

bkontur mentioned this pull request Oct 27, 2025

[B_as_Para] Setup elastic scaling for bulletin-westend - as close as possible to the production paritytech/polkadot-bulletin-chain#81

Closed

1 task

This was referenced Nov 5, 2025

Enable elastic-scaling on Kusama AssetHub and Polkadot AssetHub polkadot-fellows/runtimes#757

Closed

asset-hub-westend: Block production not ideal with elastic scaling #10227

Open

Merge branch 'master' into lexnv/es-westend

bddc443

lexnv mentioned this pull request Nov 13, 2025

versi-net: Triaging repot for elastic scaling #10310

Open

lexnv mentioned this pull request Nov 25, 2025

[ElasticScaling] Enable ElasticScaling on AHKusama and AHPolkadot #10425

Open

lexnv mentioned this pull request Dec 4, 2025

test-utils/fix: Parachains test-utils relay parent descendants mock data #10541

Merged

lexnv and others added 5 commits December 16, 2025 08:08

Merge remote-tracking branch 'origin/master' into lexnv/es-westend

3795631

Signed-off-by: Alexandru Vasile <[email protected]>

para-system: Rever check disablement

131673b

Signed-off-by: Alexandru Vasile <[email protected]>

xcm: Revert cargo crates

523e286

Signed-off-by: Alexandru Vasile <[email protected]>

Update cargo lock

8d75d72

Signed-off-by: Alexandru Vasile <[email protected]>

Merge branch 'master' into lexnv/es-westend

169a643

fix test

2ba05f3

Update from github-actions[bot] running command 'fmt'

ad3baee

pepoviola approved these changes Jan 30, 2026

View reviewed changes

Merge branch 'master' into lexnv/es-westend

217b72c

sandreim approved these changes Jan 30, 2026

View reviewed changes

cumulus/parachains/runtimes/assets/asset-hub-westend/src/lib.rs Outdated Show resolved Hide resolved

cumulus/client/consensus/aura/src/collators/slot_based/slot_timer.rs Outdated Show resolved Hide resolved

lexnv and others added 2 commits January 30, 2026 16:49

Update cumulus/parachains/runtimes/assets/asset-hub-westend/src/lib.rs

bd40886

Co-authored-by: Andrei Sandu <[email protected]>

slot-timer: Remove trace log

0bb4f59

Signed-off-by: Alexandru Vasile <[email protected]>

frame/benchmark-cli: Pass relay parent offset to create parainherent

9baeb2c

data Signed-off-by: Alexandru Vasile <[email protected]>

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

ah-westend: Elastic Scaling with 3 cores on AssetHub Westend #9880

ah-westend: Elastic Scaling with 3 cores on AssetHub Westend #9880

Uh oh!

lexnv commented Sep 30, 2025 •

edited

Loading

Uh oh!

Uh oh!

Uh oh!

sandreim Oct 24, 2025

Uh oh!

lexnv Oct 27, 2025

Uh oh!

lexnv commented Nov 10, 2025

Uh oh!

lexnv commented Jan 29, 2026

Uh oh!

pepoviola commented Jan 29, 2026

Uh oh!

pepoviola commented Jan 30, 2026

Uh oh!

sandreim left a comment

Uh oh!

Uh oh!

Uh oh!

paritytech-workflow-stopper bot commented Jan 30, 2026

Uh oh!

lexnv commented Jan 30, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

ah-westend: Elastic Scaling with 3 cores on AssetHub Westend #9880

Are you sure you want to change the base?

ah-westend: Elastic Scaling with 3 cores on AssetHub Westend #9880

Uh oh!

Conversation

lexnv commented Sep 30, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Next Steps

Uh oh!

Uh oh!

Uh oh!

sandreim Oct 24, 2025

Choose a reason for hiding this comment

Uh oh!

lexnv Oct 27, 2025

Choose a reason for hiding this comment

Uh oh!

lexnv commented Nov 10, 2025

Uh oh!

lexnv commented Jan 29, 2026

Uh oh!

pepoviola commented Jan 29, 2026

Uh oh!

pepoviola commented Jan 30, 2026

Uh oh!

sandreim left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

paritytech-workflow-stopper bot commented Jan 30, 2026

Uh oh!

lexnv commented Jan 30, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

lexnv commented Sep 30, 2025 •

edited

Loading