Skip to content

TSLCP: Chain density #6186

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 6 commits into
base: master
Choose a base branch
from
Draft

TSLCP: Chain density #6186

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
1b071be
TSLCP: Chain density
fmaste Apr 22, 2025
f90132b
simplify
fmaste May 9, 2025
c0bb3c8
clean
fmaste May 9, 2025
af01093
wb | profile cluster property only in cloud profiles
fmaste May 11, 2025
d7634f3
wb | rename "trace_forwarding" profile field to properly reflect its …
fmaste May 11, 2025
540389f
wb | fix "*-notracer" profiles
fmaste May 12, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4,041 changes: 315 additions & 3,726 deletions bench/cardano-profile/data/all-profiles-coay.json
View file
Open in desktop

Large diffs are not rendered by default.

37 changes: 3 additions & 34 deletions bench/cardano-profile/data/test/chainsync-early-alonzo-coay/profile.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -283,8 +283,9 @@
"heap_limit": null,
"shutdown_on_slot_synced": 38901589,
"shutdown_on_block_synced": null,
"ssd_directory": null,
"trace_forwarding": false,
"tracing_backend": "trace-dispatcher",
"tracer": false,
"utxo_lmdb": false,
"verbatim": {}
},
Expand All @@ -306,39 +307,7 @@
"ekg": false,
"withresources": false
},
"cluster": {
"nomad": {
"namespace": "default",
"class": "",
"resources": {
"producer": {
"cores": 2,
"memory": 15000,
"memory_max": 16000
},
"explorer": {
"cores": 2,
"memory": 15000,
"memory_max": 16000
}
},
"host_volumes": null,
"fetch_logs_ssh": false
},
"aws": {
"instance_type": {
"producer": "c5.2xlarge",
"explorer": "m5.4xlarge"
},
"use_public_routing": false
},
"minimun_storage": {
"producer": 12582912,
"explorer": 14155776
},
"keep_running": false,
"ssd_directory": null
},
"cluster": null,
"extra_desc": "without cardano-tracer",
"suffix": "notrc",
"desc": "Mainnet chain syncing benchmark",
Expand Down
6 changes: 3 additions & 3 deletions bench/cardano-profile/data/test/chainsync-early-byron-coay/profile.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -283,8 +283,9 @@
"heap_limit": null,
"shutdown_on_slot_synced": 237599,
"shutdown_on_block_synced": null,
"ssd_directory": null,
"trace_forwarding": false,
"tracing_backend": "trace-dispatcher",
"tracer": false,
"utxo_lmdb": false,
"verbatim": {}
},
Expand Down Expand Up @@ -336,8 +337,7 @@
"producer": 12582912,
"explorer": 14155776
},
"keep_running": false,
"ssd_directory": null
"keep_running": false
},
"extra_desc": "without cardano-tracer",
"suffix": "notrc",
Expand Down
36 changes: 2 additions & 34 deletions bench/cardano-profile/data/test/ci-test-bage.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -282,8 +282,8 @@
"heap_limit": null,
"shutdown_on_slot_synced": null,
"shutdown_on_block_synced": 3,
"trace_forwarding": true,
"tracing_backend": "trace-dispatcher",
"tracer": true,
"utxo_lmdb": false,
"verbatim": {}
},
Expand Down Expand Up @@ -313,39 +313,7 @@
"ekg": false,
"withresources": false
},
"cluster": {
"nomad": {
"namespace": "default",
"class": "",
"resources": {
"producer": {
"cores": 2,
"memory": 15000,
"memory_max": 16000
},
"explorer": {
"cores": 2,
"memory": 15000,
"memory_max": 16000
}
},
"host_volumes": null,
"fetch_logs_ssh": false
},
"aws": {
"instance_type": {
"producer": "c5.2xlarge",
"explorer": "m5.4xlarge"
},
"use_public_routing": false
},
"minimun_storage": {
"producer": 12582912,
"explorer": 14155776
},
"keep_running": false,
"ssd_directory": null
},
"cluster": null,
"desc": "Miniature dataset, CI-friendly duration, test scale",
"name": "ci-test-bage",
"overlay": {},
Expand Down
37 changes: 3 additions & 34 deletions bench/cardano-profile/data/test/ci-test-coay/profile.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -282,8 +282,9 @@
"heap_limit": null,
"shutdown_on_slot_synced": null,
"shutdown_on_block_synced": 3,
"ssd_directory": null,
"trace_forwarding": true,
"tracing_backend": "trace-dispatcher",
"tracer": true,
"utxo_lmdb": false,
"verbatim": {}
},
Expand Down Expand Up @@ -313,39 +314,7 @@
"ekg": false,
"withresources": false
},
"cluster": {
"nomad": {
"namespace": "default",
"class": "",
"resources": {
"producer": {
"cores": 2,
"memory": 15000,
"memory_max": 16000
},
"explorer": {
"cores": 2,
"memory": 15000,
"memory_max": 16000
}
},
"host_volumes": null,
"fetch_logs_ssh": false
},
"aws": {
"instance_type": {
"producer": "c5.2xlarge",
"explorer": "m5.4xlarge"
},
"use_public_routing": false
},
"minimun_storage": {
"producer": 12582912,
"explorer": 14155776
},
"keep_running": false,
"ssd_directory": null
},
"cluster": null,
"desc": "Miniature dataset, CI-friendly duration, test scale",
"name": "ci-test-coay",
"overlay": {},
Expand Down
37 changes: 3 additions & 34 deletions bench/cardano-profile/data/test/ci-test-dense10-coay/profile.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -282,8 +282,9 @@
"heap_limit": null,
"shutdown_on_slot_synced": null,
"shutdown_on_block_synced": 3,
"ssd_directory": null,
"trace_forwarding": true,
"tracing_backend": "trace-dispatcher",
"tracer": true,
"utxo_lmdb": false,
"verbatim": {}
},
Expand Down Expand Up @@ -313,39 +314,7 @@
"ekg": false,
"withresources": false
},
"cluster": {
"nomad": {
"namespace": "default",
"class": "",
"resources": {
"producer": {
"cores": 2,
"memory": 15000,
"memory_max": 16000
},
"explorer": {
"cores": 2,
"memory": 15000,
"memory_max": 16000
}
},
"host_volumes": null,
"fetch_logs_ssh": false
},
"aws": {
"instance_type": {
"producer": "c5.2xlarge",
"explorer": "m5.4xlarge"
},
"use_public_routing": false
},
"minimun_storage": {
"producer": 12582912,
"explorer": 14155776
},
"keep_running": false,
"ssd_directory": null
},
"cluster": null,
"desc": "Miniature dataset, CI-friendly duration, test scale",
"name": "ci-test-dense10-coay",
"overlay": {},
Expand Down
37 changes: 3 additions & 34 deletions bench/cardano-profile/data/test/default-coay/profile.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -282,8 +282,9 @@
"heap_limit": null,
"shutdown_on_slot_synced": null,
"shutdown_on_block_synced": null,
"ssd_directory": null,
"trace_forwarding": true,
"tracing_backend": "trace-dispatcher",
"tracer": true,
"utxo_lmdb": false,
"verbatim": {}
},
Expand Down Expand Up @@ -315,39 +316,7 @@
"ekg": false,
"withresources": false
},
"cluster": {
"nomad": {
"namespace": "default",
"class": "",
"resources": {
"producer": {
"cores": 2,
"memory": 15000,
"memory_max": 16000
},
"explorer": {
"cores": 2,
"memory": 15000,
"memory_max": 16000
}
},
"host_volumes": null,
"fetch_logs_ssh": false
},
"aws": {
"instance_type": {
"producer": "c5.2xlarge",
"explorer": "m5.4xlarge"
},
"use_public_routing": false
},
"minimun_storage": {
"producer": 12582912,
"explorer": 14155776
},
"keep_running": false,
"ssd_directory": null
},
"cluster": null,
"name": "default-coay",
"desc": "Default, as per nix/workbench/profile/prof0-defaults.jq",
"overlay": {},
Expand Down
6 changes: 3 additions & 3 deletions bench/cardano-profile/data/test/fast-nomadperf-coay/profile.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -477,8 +477,9 @@
"heap_limit": null,
"shutdown_on_slot_synced": null,
"shutdown_on_block_synced": 1,
"ssd_directory": null,
"trace_forwarding": true,
"tracing_backend": "trace-dispatcher",
"tracer": true,
"utxo_lmdb": false,
"verbatim": {
"EnableP2P": true
Expand Down Expand Up @@ -540,8 +541,7 @@
"producer": 12582912,
"explorer": 14155776
},
"keep_running": true,
"ssd_directory": null
"keep_running": true
},
"desc": "Stop as soon as we've seen a single block",
"extra_desc": "with P2P networking",
Expand Down
6 changes: 0 additions & 6 deletions bench/cardano-profile/src/Cardano/Benchmarking/Profile/Builtin/Empty.hs
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -114,7 +114,6 @@ profilesNoEraEmpty = map baseNoDataset
let fast =
P.empty & V.datasetEmpty . genesis . fastDuration
. P.uniCircle . P.loopback
. V.clusterDefault -- TODO: "cluster" should be "null" here.
fast1 = fast & V.hosts 1
fast2 = fast & V.hosts 2
in [
Expand All @@ -134,7 +133,6 @@ profilesNoEraEmpty = map baseNoDataset
let ciTest =
P.empty & V.datasetEmpty . genesis . ciTestDuration
. P.uniCircle . V.hosts 2 . P.loopback
. V.clusterDefault -- TODO: "cluster" should be "null" here.
in [
-- Local
ciTest & P.name "ci-test" . V.valueLocal . P.traceForwardingOn . P.newTracing . P.p2pOff
Expand All @@ -152,7 +150,6 @@ profilesNoEraEmpty = map baseNoDataset
P.empty & V.datasetEmpty . V.genesisVariantPreVoltaire . ciTestDuration
. P.uniCircle . V.hosts 2 . P.loopback
. P.analysisSizeSmall
. V.clusterDefault -- TODO: "cluster" should be "null" here.
in [
-- intricacies of fee calculation..., default fee works for ci-test-plutus and ci-bench-plutus
ciTestHydra & P.name "ci-test-hydra" . P.txFeeOverwrite 1380000 . V.plutusLoop . P.traceForwardingOn . P.newTracing . P.p2pOn . P.blocksize64k
Expand All @@ -166,7 +163,6 @@ profilesNoEraEmpty = map baseNoDataset
-- TODO: "default-*" uses 6 nodes and `uniCircle`.
. P.torus . V.hosts 6 . P.loopback
. P.tracerWithresources
. V.clusterDefault -- TODO: "cluster" should be "null" here.
bench = trace & traceBenchDuration
full = trace & traceFullDuration
in [
Expand All @@ -190,7 +186,6 @@ profilesNoEraEmpty = map baseNoDataset
-- TODO: The only one without 0 delegators.
-- Fix and remove `baseNoDataset` (Same `base` for all).
. P.utxo 0 . P.delegators 6 . P.dreps 0
. V.clusterDefault -- TODO: "cluster" should be "null" here.
value = noCliStop & V.genesisVariant300
-- TODO: "fast-plutus" and "ci-test-plutus" are using `genesisVariant300`.
plutus = noCliStop & V.genesisVariantPreVoltaire
Expand All @@ -214,7 +209,6 @@ profilesNoEraEmpty = map baseNoDataset
let ep =
P.empty & V.datasetEmpty . genesis . epochTransitionDuration
. P.uniCircle . V.hosts 2 . P.loopback
. V.clusterDefault -- TODO: "cluster" should be "null" here.
in [
ep & P.name "epoch-transition" . V.valueLocal . P.traceForwardingOn . P.newTracing . P.p2pOff
]
1 change: 0 additions & 1 deletion bench/cardano-profile/src/Cardano/Benchmarking/Profile/Builtin/ForgeStress.hs
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -29,7 +29,6 @@ base =
. P.p2pOff . P.newTracing
. P.initCooldown 5
. P.analysisStandard
. V.clusterDefault -- TODO: "cluster" should be "null" here.

-- Helpers by timescale:

Expand Down
1 change: 0 additions & 1 deletion bench/cardano-profile/src/Cardano/Benchmarking/Profile/Builtin/K3.hs
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -35,7 +35,6 @@ profilesNoEraK3 =
. P.p2pOff
. P.traceForwardingOn . P.newTracing
. P.analysisStandard . P.analysisUnitary
. V.clusterDefault -- TODO: "cluster" should be "null" here.
in [
k3 & P.name "k3-3ep-5kTx-10000kU-1300kD-64kbs-fixed-loaded" . V.valueBase . P.slotDuration 0.2 . P.tps 12
, k3 & P.name "k3-3ep-9kTx-10000kU-1300kD-64kbs-5tps-fixed-loaded" . V.valueBase . P.slotDuration 1 . P.tps 5
Expand Down
1 change: 0 additions & 1 deletion bench/cardano-profile/src/Cardano/Benchmarking/Profile/Builtin/Legacy/Dense.hs
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -29,7 +29,6 @@ profilesNoEraDense =
. V.genesisVariant300
. E.ciTestDuration
. P.cBlockMinimumAdoptions 9
. V.clusterDefault -- TODO: "cluster" should be "null" here.
in [
ciTestDense & P.name "ci-test-dense10" . V.valueLocal . P.traceForwardingOn . P.newTracing . P.p2pOff
]
2 changes: 0 additions & 2 deletions bench/cardano-profile/src/Cardano/Benchmarking/Profile/Builtin/Miniature.hs
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -64,7 +64,6 @@ profilesNoEraMiniature =
. P.desc "Miniature dataset, CI-friendly duration, bench scale"
. P.uniCircle . P.loopback
. benchDuration
. V.clusterDefault -- TODO: "cluster" should be "null" here.
-- Helpers by size:
ciBench02 = ciBench & V.hosts 2
ciBench10 = ciBench & V.hosts 10
Expand Down Expand Up @@ -114,7 +113,6 @@ profilesNoEraMiniature =
. P.dreps 0
. P.p2pOn
. P.analysisSizeFull . P.analysisUnitary
. V.clusterDefault -- TODO: "cluster" should be "null" here.
in [
dense & P.name "6-dense" . V.valueCloud . duration30 . P.traceForwardingOn . P.newTracing
, dense & P.name "6-dense-rtsprof" . V.valueCloud . duration30 . P.traceForwardingOn . P.newTracing . P.rtsHeapProf . P.rtsEventlogged
Expand Down
1 change: 0 additions & 1 deletion bench/cardano-profile/src/Cardano/Benchmarking/Profile/Builtin/Model.hs
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -40,7 +40,6 @@ profilesNoEraModel =
. V.fundsDouble
. P.traceForwardingOn . P.newTracing
. P.analysisStandard . P.analysisEpoch3Plus
. V.clusterDefault -- TODO: "cluster" should be "null" here.
. P.desc "Status-quo dataset, 7 epochs"
secp = V.plutusDoubleSaturation . V.plutusTypeECDSA . P.analysisSizeModerate
value = V.valueBase . P.tps 9 -- "value" with the Plutus `txFee`.
Expand Down
Loading
Loading