Skip to content

ci: isolate flaky stop/start test from integration tests - #370

Merged
louiseschmidtgen merged 5 commits into
feat/microk8s-integration-testsfrom
fix/remove-stop-start-continue-on-error
Jun 11, 2026
Merged

ci: isolate flaky stop/start test from integration tests#370
louiseschmidtgen merged 5 commits into
feat/microk8s-integration-testsfrom
fix/remove-stop-start-continue-on-error

Conversation

@louiseschmidtgen

@louiseschmidtgen louiseschmidtgen commented Jun 11, 2026

Copy link
Copy Markdown
Contributor

Closing — all changes merged directly into PR #369 (feat/microk8s-integration-tests).

Split 'Run simple integration tests' into two steps:
- The 4 k8s-dqlite-relevant tests run without continue-on-error so
  regressions fail the job.
- test_microk8s_stop_start runs separately with continue-on-error until
  canonical/microk8s#5546 (add wait_for_installation() after start)
  lands on master.

Use python -m pytest directly instead of tox -e simple so we can pass
the -k filter without modifying the microk8s tox config.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@louiseschmidtgen
louiseschmidtgen requested a review from a team as a code owner June 11, 2026 06:58
louiseschmidtgen and others added 4 commits June 11, 2026 09:03
canonical/microk8s#5546 adds wait_for_installation() after microk8s.start,
so coredns is guaranteed to be running before the assertion. The flakiness
is fixed upstream; no need to tolerate failures here.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
- Add cluster functions to microk8s_util: get_join_token, join_cluster,
  wait_until_ready, ready_nodes, get_local_node_status. These mirror the
  k8s-snap equivalents in test_util.util but use microk8s commands.
  get_join_token parses the output of 'microk8s add-node'; each call
  produces a unique token so the assert join_token != join_token_2 holds.
- Remove skipif from test_three_node_load and test_three_node_read_load.
  Both tests now branch on USE_MICROK8S for join/wait/status operations.
- Fix configure_argocd docstring (was '""" ""Configures...') and make
  kubectl command conditional on USE_MICROK8S.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
These tests only run against MicroK8s. Remove all USE_MICROK8S
conditionals and the dead k8s-snap branches:

- conftest.py: drop USE_MICROK8S env check, always use microk8s_util
- test_multi_node.py: call microk8s_util directly, no branching
- test_multi_node_read.py: same; configure_argocd uses microk8s kubectl
- kube_burner.py: always use 'microk8s config', drop USE_MICROK8S
- metrics.py: K8S_DQLITE_SERVICE is always microk8s.daemon-k8s-dqlite
- tox.ini: drop USE_MICROK8S from passenv
- microk8s-integration.yaml: drop 'export USE_MICROK8S=true'

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown

Benchmark

Results
goos: linux
goarch: amd64
pkg: github.com/canonical/k8s-dqlite/test
cpu: AMD EPYC 9V74 80-Core Processor                
                                        │    Before    │               After               │
                                        │    sec/op    │   sec/op     vs base              │
Compaction/sqlite-4                       29.11µ ±  4%   29.03µ ± 2%       ~ (p=1.000 n=7)
Compaction/dqlite-4                       93.91µ ±  2%   94.49µ ± 2%       ~ (p=0.535 n=7)
Create/sqlite/1-workers-4                 429.2µ ± 34%   424.8µ ± 2%       ~ (p=0.165 n=7)
Create/sqlite/4-workers-4                 149.5µ ± 10%   147.1µ ± 2%       ~ (p=0.053 n=7)
Create/sqlite/16-workers-4                69.14µ ±  4%   68.25µ ± 2%       ~ (p=0.097 n=7)
Create/sqlite/64-workers-4                44.71µ ±  4%   44.72µ ± 2%       ~ (p=0.710 n=7)
Create/sqlite/128-workers-4               38.80µ ±  7%   38.93µ ± 4%       ~ (p=1.000 n=7)
Create/dqlite/1-workers-4                 735.2µ ±  2%   733.1µ ± 2%       ~ (p=0.902 n=7)
Create/dqlite/4-workers-4                 412.5µ ±  8%   424.9µ ± 5%       ~ (p=0.318 n=7)
Create/dqlite/16-workers-4                187.6µ ±  3%   185.4µ ± 2%       ~ (p=0.318 n=7)
Create/dqlite/64-workers-4                120.5µ ±  2%   118.6µ ± 6%       ~ (p=0.119 n=7)
Create/dqlite/128-workers-4               108.6µ ±  2%   107.8µ ± 1%       ~ (p=0.165 n=7)
Delete/sqlite/1-workers-4                 410.9µ ±  1%   408.3µ ± 1%  -0.64% (p=0.026 n=7)
Delete/sqlite/4-workers-4                 151.5µ ±  1%   150.3µ ± 1%       ~ (p=0.456 n=7)
Delete/sqlite/16-workers-4                75.35µ ±  3%   75.51µ ± 3%       ~ (p=0.535 n=7)
Delete/sqlite/64-workers-4                52.04µ ±  3%   51.48µ ± 3%       ~ (p=0.710 n=7)
Delete/sqlite/128-workers-4               46.42µ ±  4%   45.25µ ± 4%       ~ (p=0.097 n=7)
Delete/dqlite/1-workers-4                 753.9µ ±  1%   741.7µ ± 1%  -1.62% (p=0.007 n=7)
Delete/dqlite/4-workers-4                 442.2µ ±  5%   419.6µ ± 8%       ~ (p=0.165 n=7)
Delete/dqlite/16-workers-4                197.3µ ±  2%   196.0µ ± 2%  -0.67% (p=0.026 n=7)
Delete/dqlite/64-workers-4                133.9µ ±  2%   131.2µ ± 1%  -2.08% (p=0.026 n=7)
Delete/dqlite/128-workers-4               122.9µ ±  1%   120.7µ ± 1%  -1.78% (p=0.004 n=7)
Get/sqlite-4                              331.5µ ±  2%   332.3µ ± 2%       ~ (p=1.000 n=7)
Get/dqlite-4                              449.9µ ±  1%   448.9µ ± 2%       ~ (p=0.710 n=7)
List/sqlite-tiny/all-4                    4.577µ ±  3%   4.547µ ± 2%       ~ (p=0.274 n=7)
List/sqlite-tiny/pagination-4             8.627µ ±  1%   8.611µ ± 3%       ~ (p=0.259 n=7)
List/sqlite-fits-in-page/all-4            7.202µ ±  2%   7.312µ ± 2%       ~ (p=0.364 n=7)
List/sqlite-fits-in-page/pagination-4     20.43µ ±  2%   20.41µ ± 2%       ~ (p=0.535 n=7)
List/sqlite-overflows-page/all-4          17.44µ ±  2%   17.44µ ± 3%       ~ (p=0.929 n=7)
List/sqlite-overflows-page/pagination-4   28.20µ ±  3%   28.39µ ± 4%       ~ (p=0.535 n=7)
List/dqlite-tiny/all-4                    4.013µ ±  2%   4.015µ ± 1%       ~ (p=0.928 n=7)
List/dqlite-tiny/pagination-4             7.236µ ±  1%   7.217µ ± 1%       ~ (p=0.259 n=7)
List/dqlite-fits-in-page/all-4            7.626µ ±  1%   7.659µ ± 1%       ~ (p=0.259 n=7)
List/dqlite-fits-in-page/pagination-4     17.80µ ±  1%   17.93µ ± 1%  +0.72% (p=0.011 n=7)
List/dqlite-overflows-page/all-4          20.92µ ±  5%   20.95µ ± 5%       ~ (p=0.535 n=7)
List/dqlite-overflows-page/pagination-4   27.49µ ±  1%   27.54µ ± 1%       ~ (p=0.620 n=7)
Update/sqlite/1-workers-4                 424.4µ ±  4%   421.6µ ± 2%       ~ (p=0.165 n=7)
Update/sqlite/4-workers-4                 154.6µ ±  2%   153.7µ ± 2%       ~ (p=0.318 n=7)
Update/sqlite/16-workers-4                73.65µ ±  3%   73.35µ ± 3%       ~ (p=0.805 n=7)
Update/sqlite/64-workers-4                49.05µ ±  3%   50.06µ ± 3%       ~ (p=0.097 n=7)
Update/sqlite/128-workers-4               44.35µ ±  3%   43.65µ ± 3%       ~ (p=0.259 n=7)
Update/dqlite/1-workers-4                 746.6µ ±  1%   743.5µ ± 2%       ~ (p=0.209 n=7)
Update/dqlite/4-workers-4                 438.8µ ±  5%   420.2µ ± 2%       ~ (p=0.053 n=7)
Update/dqlite/16-workers-4                206.5µ ±  3%   206.3µ ± 1%       ~ (p=0.710 n=7)
Update/dqlite/64-workers-4                137.7µ ±  2%   136.6µ ± 5%       ~ (p=0.535 n=7)
Update/dqlite/128-workers-4               119.4µ ±  3%   119.5µ ± 1%       ~ (p=1.000 n=7)
geomean                                   79.18µ         78.76µ       -0.53%

                                        │        Before        │                    After                     │
                                        │ page-cache-misses/op │ page-cache-misses/op  vs base                │
Compaction/sqlite-4                               0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Compaction/dqlite-4                               0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Get/sqlite-4                                      0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Get/dqlite-4                                      0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/all-4                            0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/pagination-4                     0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/all-4                    0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/pagination-4             0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/all-4                  0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/pagination-4           0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/all-4                            0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/pagination-4                     0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/all-4                    0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/pagination-4             0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/all-4                  0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/pagination-4           0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                                      ²                         +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                                        │        Before        │                    After                     │
                                        │ page-cache-spills/op │ page-cache-spills/op  vs base                │
Compaction/sqlite-4                               0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Compaction/dqlite-4                               0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Get/sqlite-4                                      0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Get/dqlite-4                                      0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/all-4                            0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/pagination-4                     0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/all-4                    0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/pagination-4             0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/all-4                  0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/pagination-4           0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/all-4                            0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/pagination-4                     0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/all-4                    0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/pagination-4             0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/all-4                  0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/pagination-4           0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                                      ²                         +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                                        │    Before     │                After                │
                                        │ page-reads/op │ page-reads/op  vs base              │
Compaction/sqlite-4                          15.08 ± 1%      15.06 ± 2%       ~ (p=0.737 n=7)
Compaction/dqlite-4                          15.27 ± 1%      15.18 ± 1%       ~ (p=0.488 n=7)
Create/sqlite/1-workers-4                    11.91 ± 1%      11.92 ± 0%       ~ (p=0.080 n=7)
Create/sqlite/4-workers-4                    8.405 ± 0%      8.418 ± 0%  +0.15% (p=0.041 n=7)
Create/sqlite/16-workers-4                   8.256 ± 0%      8.252 ± 0%       ~ (p=0.876 n=7)
Create/sqlite/64-workers-4                   8.192 ± 0%      8.192 ± 0%       ~ (p=0.871 n=7)
Create/sqlite/128-workers-4                  8.184 ± 0%      8.180 ± 0%       ~ (p=0.643 n=7)
Create/dqlite/1-workers-4                    7.635 ± 2%      7.560 ± 3%  -0.98% (p=0.026 n=7)
Create/dqlite/4-workers-4                    8.500 ± 0%      8.497 ± 0%       ~ (p=0.247 n=7)
Create/dqlite/16-workers-4                   8.232 ± 0%      8.236 ± 0%       ~ (p=0.773 n=7)
Create/dqlite/64-workers-4                   8.165 ± 0%      8.168 ± 0%       ~ (p=0.114 n=7)
Create/dqlite/128-workers-4                  8.163 ± 0%      8.159 ± 0%       ~ (p=0.302 n=7)
Delete/sqlite/1-workers-4                    14.48 ± 0%      14.48 ± 0%       ~ (p=0.473 n=7)
Delete/sqlite/4-workers-4                    12.40 ± 0%      12.42 ± 1%       ~ (p=0.478 n=7)
Delete/sqlite/16-workers-4                   14.79 ± 0%      14.82 ± 0%       ~ (p=0.435 n=7)
Delete/sqlite/64-workers-4                   14.85 ± 0%      14.85 ± 0%       ~ (p=0.804 n=7)
Delete/sqlite/128-workers-4                  14.87 ± 0%      14.87 ± 0%       ~ (p=0.837 n=7)
Delete/dqlite/1-workers-4                    9.664 ± 1%      9.427 ± 1%  -2.45% (p=0.001 n=7)
Delete/dqlite/4-workers-4                    11.05 ± 0%      11.04 ± 0%       ~ (p=0.350 n=7)
Delete/dqlite/16-workers-4                   10.94 ± 3%      10.98 ± 5%       ~ (p=0.434 n=7)
Delete/dqlite/64-workers-4                   12.48 ± 4%      12.91 ± 5%       ~ (p=0.234 n=7)
Delete/dqlite/128-workers-4                  12.91 ± 3%      12.92 ± 0%       ~ (p=0.932 n=7)
Get/sqlite-4                                 12.24 ± 0%      12.25 ± 0%       ~ (p=0.876 n=7)
Get/dqlite-4                                 12.27 ± 1%      12.26 ± 0%       ~ (p=0.596 n=7)
List/sqlite-tiny/all-4                      379.6m ± 0%     379.3m ± 0%       ~ (p=0.161 n=7)
List/sqlite-tiny/pagination-4                1.319 ± 3%      1.319 ± 3%       ~ (p=0.530 n=7)
List/sqlite-fits-in-page/all-4              323.2m ± 0%     323.4m ± 0%       ~ (p=0.157 n=7)
List/sqlite-fits-in-page/pagination-4        1.125 ± 3%      1.125 ± 3%       ~ (p=0.559 n=7)
List/sqlite-overflows-page/all-4            364.8m ± 0%     364.6m ± 0%       ~ (p=0.242 n=7)
List/sqlite-overflows-page/pagination-4      1.260 ± 0%      1.260 ± 0%       ~ (p=0.462 n=7)
List/dqlite-tiny/all-4                      378.3m ± 0%     377.4m ± 0%       ~ (p=0.145 n=7)
List/dqlite-tiny/pagination-4                1.313 ± 0%      1.313 ± 3%       ~ (p=0.462 n=7)
List/dqlite-fits-in-page/all-4              321.6m ± 0%     321.6m ± 0%       ~ (p=0.918 n=7)
List/dqlite-fits-in-page/pagination-4        1.114 ± 3%      1.115 ± 0%       ~ (p=0.078 n=7)
List/dqlite-overflows-page/all-4            361.1m ± 0%     361.0m ± 0%       ~ (p=0.557 n=7)
List/dqlite-overflows-page/pagination-4      1.250 ± 0%      1.250 ± 0%       ~ (p=1.000 n=7)
Update/sqlite/1-workers-4                    14.14 ± 0%      14.14 ± 0%       ~ (p=1.000 n=7)
Update/sqlite/4-workers-4                    10.26 ± 0%      10.27 ± 0%       ~ (p=0.364 n=7)
Update/sqlite/16-workers-4                   10.12 ± 0%      10.11 ± 0%       ~ (p=0.448 n=7)
Update/sqlite/64-workers-4                   10.09 ± 0%      10.10 ± 0%       ~ (p=0.684 n=7)
Update/sqlite/128-workers-4                  10.35 ± 1%      10.33 ± 1%       ~ (p=0.876 n=7)
Update/dqlite/1-workers-4                    9.681 ± 1%      9.602 ± 2%       ~ (p=0.259 n=7)
Update/dqlite/4-workers-4                    10.54 ± 0%      10.50 ± 0%  -0.38% (p=0.022 n=7)
Update/dqlite/16-workers-4                   10.20 ± 0%      10.19 ± 0%       ~ (p=0.481 n=7)
Update/dqlite/64-workers-4                   10.15 ± 0%      10.13 ± 0%       ~ (p=0.134 n=7)
Update/dqlite/128-workers-4                  10.13 ± 0%      10.13 ± 0%       ~ (p=0.885 n=7)
geomean                                      5.196           5.194       -0.04%

                                        │     Before      │                 After                  │
                                        │ page-writes/op  │ page-writes/op  vs base                │
Compaction/sqlite-4                        88.00m ± 33%       84.43m ± 40%       ~ (p=0.620 n=7)
Compaction/dqlite-4                       108.70m ± 31%       89.81m ± 27%       ~ (p=0.456 n=7)
Create/sqlite/1-workers-4                   3.210 ±  0%        3.213 ±  0%  +0.09% (p=0.021 n=7)
Create/sqlite/4-workers-4                   2.007 ±  1%        2.016 ±  1%       ~ (p=0.364 n=7)
Create/sqlite/16-workers-4                 744.2m ±  2%       742.8m ±  2%       ~ (p=0.259 n=7)
Create/sqlite/64-workers-4                 327.8m ±  5%       331.4m ±  4%       ~ (p=0.902 n=7)
Create/sqlite/128-workers-4                239.0m ±  5%       237.9m ±  3%       ~ (p=0.710 n=7)
Create/dqlite/1-workers-4                   3.194 ±  0%        3.191 ±  0%  -0.09% (p=0.011 n=7)
Create/dqlite/4-workers-4                   1.707 ±  0%        1.705 ±  0%       ~ (p=0.357 n=7)
Create/dqlite/16-workers-4                 556.4m ±  4%       549.5m ±  2%       ~ (p=0.076 n=7)
Create/dqlite/64-workers-4                 200.3m ±  3%       203.5m ±  8%       ~ (p=1.000 n=7)
Create/dqlite/128-workers-4                120.2m ±  4%       122.5m ±  3%       ~ (p=0.318 n=7)
Delete/sqlite/1-workers-4                   3.273 ±  0%        3.274 ±  0%       ~ (p=0.602 n=7)
Delete/sqlite/4-workers-4                   2.133 ±  2%        2.156 ±  3%       ~ (p=0.165 n=7)
Delete/sqlite/16-workers-4                  1.023 ±  8%        1.032 ±  5%       ~ (p=0.971 n=7)
Delete/sqlite/64-workers-4                 607.6m ±  5%       603.4m ±  4%       ~ (p=1.000 n=7)
Delete/sqlite/128-workers-4                507.8m ±  6%       501.8m ±  6%       ~ (p=0.644 n=7)
Delete/dqlite/1-workers-4                   3.266 ±  1%        3.266 ±  1%       ~ (p=0.436 n=7)
Delete/dqlite/4-workers-4                   1.786 ±  1%        1.779 ±  1%       ~ (p=0.066 n=7)
Delete/dqlite/16-workers-4                 627.2m ±  1%       628.0m ±  2%       ~ (p=0.902 n=7)
Delete/dqlite/64-workers-4                 286.5m ±  7%       272.7m ±  5%       ~ (p=0.073 n=7)
Delete/dqlite/128-workers-4                190.9m ±  6%       192.7m ± 10%       ~ (p=0.902 n=7)
Get/sqlite-4                                0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
Get/dqlite-4                                0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/all-4                      0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/pagination-4               0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/all-4              0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/pagination-4       0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/all-4            0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/pagination-4     0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/all-4                      0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/pagination-4               0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/all-4              0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/pagination-4       0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/all-4            0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/pagination-4     0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
Update/sqlite/1-workers-4                   3.419 ±  0%        3.420 ±  0%       ~ (p=0.266 n=7)
Update/sqlite/4-workers-4                   2.496 ±  1%        2.504 ±  1%       ~ (p=0.805 n=7)
Update/sqlite/16-workers-4                  1.548 ±  1%        1.551 ±  1%       ~ (p=1.000 n=7)
Update/sqlite/64-workers-4                  1.106 ±  1%        1.105 ±  1%       ~ (p=0.649 n=7)
Update/sqlite/128-workers-4                919.4m ±  1%       910.5m ±  2%       ~ (p=0.128 n=7)
Update/dqlite/1-workers-4                   3.375 ±  0%        3.373 ±  0%       ~ (p=0.908 n=7)
Update/dqlite/4-workers-4                   2.175 ±  2%        2.165 ±  1%       ~ (p=0.066 n=7)
Update/dqlite/16-workers-4                  1.248 ±  5%        1.223 ±  3%       ~ (p=0.097 n=7)
Update/dqlite/64-workers-4                 719.9m ± 18%       700.7m ± 10%       ~ (p=0.902 n=7)
Update/dqlite/128-workers-4                397.3m ± 25%       412.5m ±  9%       ~ (p=0.165 n=7)
geomean                                                 ²                   -0.57%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                                        │     Before     │                 After                 │
                                        │ sec-reading/op │ sec-reading/op  vs base               │
Compaction/sqlite-4                         61.80µ ±  6%     62.40µ ±  2%        ~ (p=0.967 n=7)
Compaction/dqlite-4                         85.30µ ± 18%     73.70µ ± 19%        ~ (p=0.382 n=7)
Create/sqlite/1-workers-4                   35.80µ ± 22%     34.30µ ± 17%        ~ (p=0.511 n=7)
Create/sqlite/4-workers-4                   64.80µ ± 11%     63.80µ ±  6%        ~ (p=0.619 n=7)
Create/sqlite/16-workers-4                  37.00µ ±  8%     34.90µ ±  6%   -5.68% (p=0.005 n=7)
Create/sqlite/64-workers-4                  20.90µ ±  6%     20.00µ ±  8%        ~ (p=0.456 n=7)
Create/sqlite/128-workers-4                 16.80µ ± 10%     16.80µ ±  4%        ~ (p=0.694 n=7)
Create/dqlite/1-workers-4                   15.50µ ± 51%     14.10µ ± 29%        ~ (p=0.402 n=7)
Create/dqlite/4-workers-4                   17.20µ ± 22%     11.90µ ± 51%        ~ (p=0.073 n=7)
Create/dqlite/16-workers-4                  6.000µ ± 23%     7.200µ ± 26%        ~ (p=0.104 n=7)
Create/dqlite/64-workers-4                  3.100µ ± 58%     3.300µ ± 18%        ~ (p=0.882 n=7)
Create/dqlite/128-workers-4                 2.400µ ± 54%     2.300µ ± 30%        ~ (p=0.443 n=7)
Delete/sqlite/1-workers-4                   49.10µ ±  9%     48.40µ ±  6%        ~ (p=0.196 n=7)
Delete/sqlite/4-workers-4                   77.40µ ±  5%     76.10µ ±  4%        ~ (p=0.330 n=7)
Delete/sqlite/16-workers-4                  53.80µ ±  7%     56.00µ ±  8%        ~ (p=0.220 n=7)
Delete/sqlite/64-workers-4                  41.10µ ±  3%     41.30µ ±  3%        ~ (p=0.275 n=7)
Delete/sqlite/128-workers-4                 38.10µ ±  3%     37.70µ ±  4%        ~ (p=0.275 n=7)
Delete/dqlite/1-workers-4                   20.70µ ± 29%     20.80µ ± 11%        ~ (p=0.435 n=7)
Delete/dqlite/4-workers-4                   23.80µ ± 23%     19.00µ ± 66%        ~ (p=0.128 n=7)
Delete/dqlite/16-workers-4                  13.80µ ± 19%     13.90µ ± 16%        ~ (p=0.685 n=7)
Delete/dqlite/64-workers-4                  10.10µ ± 22%     10.70µ ± 14%        ~ (p=0.902 n=7)
Delete/dqlite/128-workers-4                 9.900µ ± 18%    10.100µ ± 15%        ~ (p=1.000 n=7)
Get/sqlite-4                                80.10µ ± 12%     83.00µ ±  8%        ~ (p=0.259 n=7)
Get/dqlite-4                                49.40µ ±  9%     47.00µ ±  7%        ~ (p=0.097 n=7)
List/sqlite-tiny/all-4                      10.30µ ±  4%     10.00µ ±  2%        ~ (p=0.160 n=7)
List/sqlite-tiny/pagination-4               18.00µ ±  2%     18.00µ ±  2%        ~ (p=0.317 n=7)
List/sqlite-fits-in-page/all-4              15.10µ ±  1%     15.20µ ±  1%        ~ (p=0.318 n=7)
List/sqlite-fits-in-page/pagination-4       37.90µ ±  2%     37.60µ ±  2%        ~ (p=0.589 n=7)
List/sqlite-overflows-page/all-4            33.20µ ±  2%     33.10µ ±  2%        ~ (p=0.777 n=7)
List/sqlite-overflows-page/pagination-4     52.40µ ±  2%     52.10µ ±  2%        ~ (p=0.277 n=7)
List/dqlite-tiny/all-4                      5.900µ ± 24%     6.000µ ± 18%        ~ (p=0.723 n=7)
List/dqlite-tiny/pagination-4               10.20µ ± 14%     10.10µ ± 14%        ~ (p=0.737 n=7)
List/dqlite-fits-in-page/all-4              12.50µ ± 10%     13.60µ ± 14%        ~ (p=0.399 n=7)
List/dqlite-fits-in-page/pagination-4       29.80µ ±  8%     30.80µ ±  8%        ~ (p=0.301 n=7)
List/dqlite-overflows-page/all-4            36.60µ ±  3%     36.90µ ±  3%        ~ (p=0.196 n=7)
List/dqlite-overflows-page/pagination-4     49.20µ ±  7%     49.20µ ±  3%        ~ (p=0.938 n=7)
Update/sqlite/1-workers-4                   35.80µ ± 13%     33.80µ ± 11%        ~ (p=0.165 n=7)
Update/sqlite/4-workers-4                   69.70µ ±  9%     68.30µ ±  4%        ~ (p=0.259 n=7)
Update/sqlite/16-workers-4                  43.10µ ±  6%     41.60µ ±  3%        ~ (p=0.219 n=7)
Update/sqlite/64-workers-4                  25.50µ ±  7%     26.20µ ±  6%        ~ (p=0.642 n=7)
Update/sqlite/128-workers-4                 20.90µ ±  7%     20.60µ ± 12%        ~ (p=0.591 n=7)
Update/dqlite/1-workers-4                   14.10µ ± 31%     15.00µ ± 23%        ~ (p=0.830 n=7)
Update/dqlite/4-workers-4                   16.90µ ± 44%     12.00µ ± 21%  -28.99% (p=0.034 n=7)
Update/dqlite/16-workers-4                  8.000µ ± 19%     8.700µ ± 23%        ~ (p=0.435 n=7)
Update/dqlite/64-workers-4                  4.400µ ± 39%     4.500µ ± 31%        ~ (p=0.976 n=7)
Update/dqlite/128-workers-4                 3.300µ ± 36%     3.200µ ± 16%        ~ (p=0.828 n=7)
geomean                                     21.49µ           21.07µ         -1.97%

                                        │     Before     │                 After                  │
                                        │ sec-writing/op │ sec-writing/op  vs base                │
Compaction/sqlite-4                       16.50µ ±  5%       16.30µ ±  2%       ~ (p=0.966 n=7)
Compaction/dqlite-4                       12.20µ ±  8%       12.10µ ± 13%       ~ (p=0.929 n=7)
Create/sqlite/1-workers-4                 192.7µ ± 76%       187.9µ ±  5%       ~ (p=0.620 n=7)
Create/sqlite/4-workers-4                 72.90µ ± 16%       72.70µ ±  5%       ~ (p=0.402 n=7)
Create/sqlite/16-workers-4                24.70µ ± 10%       24.80µ ±  9%       ~ (p=0.427 n=7)
Create/sqlite/64-workers-4                17.10µ ±  7%       16.90µ ±  4%       ~ (p=0.922 n=7)
Create/sqlite/128-workers-4               15.00µ ±  7%       15.10µ ±  8%       ~ (p=0.797 n=7)
Create/dqlite/1-workers-4                 38.80µ ± 14%       40.80µ ± 19%       ~ (p=0.272 n=7)
Create/dqlite/4-workers-4                 32.10µ ± 21%       28.80µ ± 31%       ~ (p=0.456 n=7)
Create/dqlite/16-workers-4                18.20µ ± 26%       17.20µ ± 12%  -5.49% (p=0.033 n=7)
Create/dqlite/64-workers-4                15.20µ ± 12%       15.00µ ± 14%       ~ (p=0.470 n=7)
Create/dqlite/128-workers-4               14.40µ ± 13%       13.90µ ± 14%       ~ (p=0.456 n=7)
Delete/sqlite/1-workers-4                 175.3µ ±  4%       175.1µ ±  6%       ~ (p=0.779 n=7)
Delete/sqlite/4-workers-4                 76.90µ ±  4%       76.70µ ±  3%       ~ (p=0.513 n=7)
Delete/sqlite/16-workers-4                29.60µ ±  7%       28.40µ ±  8%  -4.05% (p=0.034 n=7)
Delete/sqlite/64-workers-4                20.60µ ±  7%       20.30µ ±  5%       ~ (p=0.941 n=7)
Delete/sqlite/128-workers-4               18.70µ ±  7%       18.60µ ±  3%       ~ (p=0.965 n=7)
Delete/dqlite/1-workers-4                 39.70µ ± 42%       42.20µ ± 60%       ~ (p=0.535 n=7)
Delete/dqlite/4-workers-4                 32.70µ ± 14%       35.10µ ± 19%       ~ (p=0.198 n=7)
Delete/dqlite/16-workers-4                21.60µ ± 17%       22.40µ ± 21%       ~ (p=0.826 n=7)
Delete/dqlite/64-workers-4                16.00µ ± 17%       16.30µ ± 15%       ~ (p=0.478 n=7)
Delete/dqlite/128-workers-4               16.60µ ± 17%       16.60µ ± 10%       ~ (p=0.555 n=7)
Get/sqlite-4                               0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
Get/dqlite-4                               0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/all-4                     0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/pagination-4              0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/all-4             0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/pagination-4      0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/all-4           0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/pagination-4    0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/all-4                     0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/pagination-4              0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/all-4             0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/pagination-4      0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/all-4           0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/pagination-4    0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
Update/sqlite/1-workers-4                 184.9µ ± 13%       182.7µ ±  4%       ~ (p=0.245 n=7)
Update/sqlite/4-workers-4                 71.20µ ± 13%       73.60µ ±  3%       ~ (p=0.091 n=7)
Update/sqlite/16-workers-4                24.80µ ±  7%       24.90µ ±  8%       ~ (p=0.689 n=7)
Update/sqlite/64-workers-4                17.90µ ±  6%       17.80µ ±  5%       ~ (p=0.401 n=7)
Update/sqlite/128-workers-4               16.80µ ±  7%       16.20µ ±  5%       ~ (p=0.056 n=7)
Update/dqlite/1-workers-4                 45.30µ ± 23%       40.20µ ± 25%       ~ (p=0.165 n=7)
Update/dqlite/4-workers-4                 33.80µ ± 18%       34.20µ ± 21%       ~ (p=0.902 n=7)
Update/dqlite/16-workers-4                19.50µ ± 18%       20.00µ ± 15%       ~ (p=0.601 n=7)
Update/dqlite/64-workers-4                16.40µ ±  8%       15.40µ ± 14%       ~ (p=0.437 n=7)
Update/dqlite/128-workers-4               15.00µ ± 26%       15.50µ ± 21%       ~ (p=0.512 n=7)
geomean                                                ²                   -0.48%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                                        │    Before     │                After                │
                                        │     B/op      │     B/op       vs base              │
Compaction/sqlite-4                       3.051Ki ± 13%   3.092Ki ±  6%       ~ (p=0.710 n=7)
Compaction/dqlite-4                       13.75Ki ±  0%   13.75Ki ±  0%       ~ (p=0.977 n=7)
Create/sqlite/1-workers-4                 21.66Ki ±  0%   21.66Ki ±  0%       ~ (p=0.403 n=7)
Create/sqlite/4-workers-4                 19.89Ki ±  0%   19.90Ki ±  0%  +0.03% (p=0.009 n=7)
Create/sqlite/16-workers-4                17.99Ki ±  0%   17.99Ki ±  0%       ~ (p=0.066 n=7)
Create/sqlite/64-workers-4                17.44Ki ±  0%   17.44Ki ±  0%       ~ (p=0.058 n=7)
Create/sqlite/128-workers-4               17.35Ki ±  0%   17.35Ki ±  0%       ~ (p=0.498 n=7)
Create/dqlite/1-workers-4                 20.80Ki ±  0%   20.79Ki ±  0%       ~ (p=0.274 n=7)
Create/dqlite/4-workers-4                 18.49Ki ±  3%   18.06Ki ±  5%       ~ (p=0.735 n=7)
Create/dqlite/16-workers-4                17.29Ki ±  0%   17.30Ki ±  0%       ~ (p=0.927 n=7)
Create/dqlite/64-workers-4                16.89Ki ±  0%   16.90Ki ±  0%       ~ (p=0.557 n=7)
Create/dqlite/128-workers-4               16.84Ki ±  0%   16.84Ki ±  0%       ~ (p=0.120 n=7)
Delete/sqlite/1-workers-4                 24.27Ki ±  0%   24.27Ki ±  0%       ~ (p=0.928 n=7)
Delete/sqlite/4-workers-4                 22.54Ki ±  0%   22.54Ki ±  0%       ~ (p=0.557 n=7)
Delete/sqlite/16-workers-4                20.64Ki ±  0%   20.65Ki ±  0%  +0.03% (p=0.048 n=7)
Delete/sqlite/64-workers-4                20.15Ki ±  0%   20.15Ki ±  0%       ~ (p=0.924 n=7)
Delete/sqlite/128-workers-4               20.07Ki ±  0%   20.07Ki ±  0%       ~ (p=0.564 n=7)
Delete/dqlite/1-workers-4                 23.34Ki ±  0%   23.36Ki ±  0%       ~ (p=0.402 n=7)
Delete/dqlite/4-workers-4                 21.42Ki ±  4%   20.51Ki ±  5%       ~ (p=0.138 n=7)
Delete/dqlite/16-workers-4                19.79Ki ±  0%   19.79Ki ±  0%       ~ (p=0.437 n=7)
Delete/dqlite/64-workers-4                19.41Ki ±  0%   19.41Ki ±  0%       ~ (p=0.178 n=7)
Delete/dqlite/128-workers-4               19.36Ki ±  0%   19.36Ki ±  0%       ~ (p=0.502 n=7)
Get/sqlite-4                              22.87Ki ±  0%   22.87Ki ±  0%       ~ (p=0.553 n=7)
Get/dqlite-4                              21.73Ki ±  0%   21.76Ki ±  0%       ~ (p=0.512 n=7)
List/sqlite-tiny/all-4                    1.332Ki ±  3%   1.271Ki ±  5%  -4.62% (p=0.019 n=7)
List/sqlite-tiny/pagination-4             1.788Ki ±  2%   1.757Ki ±  3%       ~ (p=0.165 n=7)
List/sqlite-fits-in-page/all-4            6.475Ki ±  8%   6.532Ki ±  7%       ~ (p=0.456 n=7)
List/sqlite-fits-in-page/pagination-4     8.307Ki ±  1%   8.305Ki ±  4%       ~ (p=0.924 n=7)
List/sqlite-overflows-page/all-4          33.67Ki ±  7%   33.74Ki ±  8%       ~ (p=0.927 n=7)
List/sqlite-overflows-page/pagination-4   36.45Ki ±  3%   36.93Ki ±  3%       ~ (p=0.934 n=7)
List/dqlite-tiny/all-4                    1.003Ki ±  4%   1.003Ki ±  7%       ~ (p=1.000 n=7)
List/dqlite-tiny/pagination-4             1.013Ki ±  2%   1.007Ki ±  2%       ~ (p=0.902 n=7)
List/dqlite-fits-in-page/all-4            5.838Ki ±  9%   5.831Ki ±  9%       ~ (p=0.925 n=7)
List/dqlite-fits-in-page/pagination-4     5.842Ki ±  5%   5.963Ki ±  3%       ~ (p=0.620 n=7)
List/dqlite-overflows-page/all-4          29.38Ki ±  3%   29.03Ki ± 11%       ~ (p=0.383 n=7)
List/dqlite-overflows-page/pagination-4   29.43Ki ±  2%   29.35Ki ±  1%       ~ (p=0.710 n=7)
Update/sqlite/1-workers-4                 22.80Ki ±  0%   22.80Ki ±  0%       ~ (p=0.111 n=7)
Update/sqlite/4-workers-4                 21.05Ki ±  0%   21.03Ki ±  0%       ~ (p=0.596 n=7)
Update/sqlite/16-workers-4                19.08Ki ±  0%   19.08Ki ±  0%       ~ (p=0.674 n=7)
Update/sqlite/64-workers-4                18.54Ki ±  0%   18.54Ki ±  0%       ~ (p=0.929 n=7)
Update/sqlite/128-workers-4               18.45Ki ±  0%   18.45Ki ±  0%  -0.02% (p=0.031 n=7)
Update/dqlite/1-workers-4                 21.91Ki ±  0%   21.86Ki ±  0%       ~ (p=0.157 n=7)
Update/dqlite/4-workers-4                 19.51Ki ±  3%   19.09Ki ±  1%       ~ (p=0.155 n=7)
Update/dqlite/16-workers-4                18.42Ki ±  0%   18.42Ki ±  0%       ~ (p=0.779 n=7)
Update/dqlite/64-workers-4                18.03Ki ±  0%   18.03Ki ±  0%  +0.03% (p=0.033 n=7)
Update/dqlite/128-workers-4               17.97Ki ±  0%   17.97Ki ±  0%       ~ (p=0.224 n=7)
geomean                                   14.03Ki         14.00Ki        -0.26%

                                        │   Before    │                After                │
                                        │  allocs/op  │  allocs/op   vs base                │
Compaction/sqlite-4                       45.00 ± 13%   45.00 ±  7%       ~ (p=0.848 n=7)
Compaction/dqlite-4                       211.0 ±  0%   211.0 ±  0%       ~ (p=1.000 n=7) ¹
Create/sqlite/1-workers-4                 406.0 ±  0%   406.0 ±  0%       ~ (p=1.000 n=7) ¹
Create/sqlite/4-workers-4                 366.0 ±  0%   366.0 ±  0%       ~ (p=0.559 n=7)
Create/sqlite/16-workers-4                317.0 ±  0%   317.0 ±  0%       ~ (p=1.000 n=7) ¹
Create/sqlite/64-workers-4                301.0 ±  0%   301.0 ±  0%       ~ (p=1.000 n=7) ¹
Create/sqlite/128-workers-4               298.0 ±  0%   298.0 ±  0%       ~ (p=1.000 n=7)
Create/dqlite/1-workers-4                 378.0 ±  0%   378.0 ±  0%       ~ (p=1.000 n=7) ¹
Create/dqlite/4-workers-4                 330.0 ±  3%   322.0 ±  6%       ~ (p=0.554 n=7)
Create/dqlite/16-workers-4                302.0 ±  0%   302.0 ±  0%       ~ (p=1.000 n=7)
Create/dqlite/64-workers-4                292.0 ±  0%   292.0 ±  0%       ~ (p=1.000 n=7) ¹
Create/dqlite/128-workers-4               290.0 ±  0%   290.0 ±  0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/1-workers-4                 432.0 ±  0%   432.0 ±  0%       ~ (p=1.000 n=7)
Delete/sqlite/4-workers-4                 392.0 ±  0%   392.0 ±  0%       ~ (p=1.000 n=7)
Delete/sqlite/16-workers-4                343.0 ±  0%   343.0 ±  0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/64-workers-4                328.0 ±  0%   328.0 ±  0%       ~ (p=1.000 n=7)
Delete/sqlite/128-workers-4               326.0 ±  0%   326.0 ±  0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/1-workers-4                 403.0 ±  0%   403.0 ±  0%       ~ (p=0.559 n=7)
Delete/dqlite/4-workers-4                 364.0 ±  5%   345.0 ±  6%       ~ (p=0.197 n=7)
Delete/dqlite/16-workers-4                327.0 ±  0%   327.0 ±  0%       ~ (p=1.000 n=7)
Delete/dqlite/64-workers-4                317.0 ±  0%   317.0 ±  0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/128-workers-4               315.0 ±  0%   315.0 ±  0%       ~ (p=1.000 n=7)
Get/sqlite-4                              398.0 ±  0%   398.0 ±  0%       ~ (p=1.000 n=7) ¹
Get/dqlite-4                              377.0 ±  0%   377.0 ±  0%       ~ (p=1.000 n=7)
List/sqlite-tiny/all-4                    15.00 ±  7%   15.00 ±  7%       ~ (p=0.559 n=7)
List/sqlite-tiny/pagination-4             23.00 ±  4%   22.00 ±  5%       ~ (p=0.266 n=7)
List/sqlite-fits-in-page/all-4            17.00 ±  6%   17.00 ±  0%       ~ (p=0.192 n=7)
List/sqlite-fits-in-page/pagination-4     34.00 ±  0%   34.00 ±  0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/all-4          22.00 ±  0%   22.00 ±  5%       ~ (p=1.000 n=7)
List/sqlite-overflows-page/pagination-4   34.00 ±  0%   34.00 ±  0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/all-4                    10.00 ± 10%   10.00 ± 10%       ~ (p=1.000 n=7)
List/dqlite-tiny/pagination-4             11.00 ±  0%   11.00 ±  0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/all-4            15.00 ±  7%   15.00 ±  7%       ~ (p=1.000 n=7)
List/dqlite-fits-in-page/pagination-4     16.00 ±  6%   16.00 ±  0%       ~ (p=1.000 n=7)
List/dqlite-overflows-page/all-4          26.00 ±  8%   26.00 ± 12%       ~ (p=0.800 n=7)
List/dqlite-overflows-page/pagination-4   27.00 ±  4%   26.00 ±  4%       ~ (p=1.000 n=7)
Update/sqlite/1-workers-4                 413.0 ±  0%   413.0 ±  0%       ~ (p=1.000 n=7) ¹
Update/sqlite/4-workers-4                 373.0 ±  0%   372.0 ±  0%       ~ (p=0.592 n=7)
Update/sqlite/16-workers-4                323.0 ±  0%   323.0 ±  0%       ~ (p=1.000 n=7) ¹
Update/sqlite/64-workers-4                308.0 ±  0%   308.0 ±  0%       ~ (p=1.000 n=7) ¹
Update/sqlite/128-workers-4               305.0 ±  0%   305.0 ±  0%       ~ (p=1.000 n=7) ¹
Update/dqlite/1-workers-4                 385.0 ±  0%   385.0 ±  0%       ~ (p=1.000 n=7) ¹
Update/dqlite/4-workers-4                 335.0 ±  3%   327.0 ±  2%  -2.39% (p=0.022 n=7)
Update/dqlite/16-workers-4                309.0 ±  0%   308.0 ±  0%       ~ (p=1.000 n=7)
Update/dqlite/64-workers-4                298.0 ±  0%   299.0 ±  0%  +0.34% (p=0.029 n=7)
Update/dqlite/128-workers-4               297.0 ±  0%   297.0 ±  0%       ~ (p=1.000 n=7) ¹
geomean                                   152.4         151.8        -0.41%
¹ all samples are equal

                                        │        Before         │                    After                    │
                                        │ network-bytes-read/op │ network-bytes-read/op  vs base              │
Compaction/dqlite-4                               4.194Ki ±  0%           4.195Ki ±  0%       ~ (p=0.793 n=7)
Create/dqlite/1-workers-4                           243.1 ±  0%             243.1 ±  0%       ~ (p=0.983 n=7)
Create/dqlite/4-workers-4                           189.7 ± 12%             171.5 ± 22%       ~ (p=0.519 n=7)
Create/dqlite/16-workers-4                          147.4 ±  1%             147.4 ±  0%       ~ (p=0.497 n=7)
Create/dqlite/64-workers-4                          134.0 ±  1%             133.9 ±  1%       ~ (p=0.733 n=7)
Create/dqlite/128-workers-4                         132.1 ±  0%             132.2 ±  1%       ~ (p=0.654 n=7)
Delete/dqlite/1-workers-4                           719.3 ±  2%             721.7 ±  2%       ~ (p=0.156 n=7)
Delete/dqlite/4-workers-4                           678.1 ±  5%             648.6 ±  5%       ~ (p=0.128 n=7)
Delete/dqlite/16-workers-4                          624.4 ±  1%             625.7 ±  1%       ~ (p=0.513 n=7)
Delete/dqlite/64-workers-4                          615.9 ±  0%             615.9 ±  0%       ~ (p=0.476 n=7)
Delete/dqlite/128-workers-4                         615.0 ±  0%             615.3 ±  1%       ~ (p=0.929 n=7)
Get/dqlite-4                                        821.1 ±  1%             820.4 ±  1%       ~ (p=0.805 n=7)
List/dqlite-tiny/all-4                              168.6 ±  4%             167.6 ±  2%       ~ (p=0.833 n=7)
List/dqlite-tiny/pagination-4                       175.7 ±  3%             176.1 ±  2%       ~ (p=0.805 n=7)
List/dqlite-fits-in-page/all-4                    1.212Ki ±  3%           1.212Ki ±  2%       ~ (p=0.772 n=7)
List/dqlite-fits-in-page/pagination-4             1.318Ki ±  3%           1.315Ki ±  2%       ~ (p=0.688 n=7)
List/dqlite-overflows-page/all-4                  6.556Ki ±  5%           6.490Ki ± 11%       ~ (p=0.710 n=7)
List/dqlite-overflows-page/pagination-4           6.623Ki ±  3%           6.604Ki ±  4%       ~ (p=0.805 n=7)
Update/dqlite/1-workers-4                           263.2 ±  0%             263.2 ±  0%       ~ (p=1.000 n=7)
Update/dqlite/4-workers-4                           203.7 ± 12%             185.8 ±  6%  -8.79% (p=0.034 n=7)
Update/dqlite/16-workers-4                          164.5 ±  0%             164.5 ±  0%       ~ (p=0.847 n=7)
Update/dqlite/64-workers-4                          150.7 ±  1%             150.9 ±  0%       ~ (p=0.234 n=7)
Update/dqlite/128-workers-4                         149.0 ±  1%             149.0 ±  1%       ~ (p=0.986 n=7)
geomean                                             464.5                   459.5        -1.08%

                                        │          Before          │                     After                      │
                                        │ network-bytes-written/op │ network-bytes-written/op  vs base              │
Compaction/dqlite-4                                    5.659 ±  1%                5.680 ±  1%       ~ (p=0.435 n=7)
Create/dqlite/1-workers-4                              128.7 ±  0%                128.5 ±  0%  -0.16% (p=0.033 n=7)
Create/dqlite/4-workers-4                              122.0 ±  9%                112.6 ± 17%       ~ (p=0.481 n=7)
Create/dqlite/16-workers-4                             99.02 ±  0%                99.04 ±  0%       ~ (p=0.477 n=7)
Create/dqlite/64-workers-4                             90.86 ±  0%                90.85 ±  0%       ~ (p=0.557 n=7)
Create/dqlite/128-workers-4                            91.04 ±  2%                90.91 ±  2%       ~ (p=0.434 n=7)
Delete/dqlite/1-workers-4                              89.94 ±  0%                90.06 ±  0%       ~ (p=0.165 n=7)
Delete/dqlite/4-workers-4                              92.41 ± 23%                71.31 ± 30%       ~ (p=0.383 n=7)
Delete/dqlite/16-workers-4                             59.45 ±  0%                59.44 ±  0%       ~ (p=0.738 n=7)
Delete/dqlite/64-workers-4                             51.21 ±  0%                51.17 ±  0%       ~ (p=0.172 n=7)
Delete/dqlite/128-workers-4                            49.89 ±  0%                49.85 ±  0%       ~ (p=0.927 n=7)
Get/dqlite-4                                           105.2 ±  0%                105.2 ±  0%       ~ (p=0.865 n=7)
List/dqlite-tiny/all-4                               0.04265 ± 10%              0.04311 ±  5%       ~ (p=0.710 n=7)
List/dqlite-tiny/pagination-4                        0.06369 ±  8%              0.06329 ±  6%       ~ (p=1.000 n=7)
List/dqlite-fits-in-page/all-4                       0.06368 ±  7%              0.06382 ±  5%       ~ (p=1.000 n=7)
List/dqlite-fits-in-page/pagination-4                 0.1142 ±  5%               0.1163 ±  7%       ~ (p=0.209 n=7)
List/dqlite-overflows-page/all-4                     0.09644 ±  6%              0.09423 ± 14%       ~ (p=0.535 n=7)
List/dqlite-overflows-page/pagination-4               0.1585 ±  3%               0.1567 ±  4%       ~ (p=0.710 n=7)
Update/dqlite/1-workers-4                              152.8 ±  0%                152.7 ±  0%       ~ (p=0.909 n=7)
Update/dqlite/4-workers-4                              143.9 ±  9%                134.6 ±  4%       ~ (p=0.082 n=7)
Update/dqlite/16-workers-4                             123.1 ±  0%                123.1 ±  0%       ~ (p=0.918 n=7)
Update/dqlite/64-workers-4                             114.8 ±  0%                114.8 ±  0%       ~ (p=0.559 n=7)
Update/dqlite/128-workers-4                            113.5 ±  0%                113.5 ±  0%       ~ (p=0.364 n=7)
geomean                                                13.52                      13.28        -1.79%
Current status
goos: linux
goarch: amd64
pkg: github.com/canonical/k8s-dqlite/test
cpu: AMD EPYC 9V74 80-Core Processor                
                                        │    After    │
                                        │   sec/op    │
Compaction/sqlite-4                       29.03µ ± 2%
Compaction/dqlite-4                       94.49µ ± 2%
Create/sqlite/1-workers-4                 424.8µ ± 2%
Create/sqlite/4-workers-4                 147.1µ ± 2%
Create/sqlite/16-workers-4                68.25µ ± 2%
Create/sqlite/64-workers-4                44.72µ ± 2%
Create/sqlite/128-workers-4               38.93µ ± 4%
Create/dqlite/1-workers-4                 733.1µ ± 2%
Create/dqlite/4-workers-4                 424.9µ ± 5%
Create/dqlite/16-workers-4                185.4µ ± 2%
Create/dqlite/64-workers-4                118.6µ ± 6%
Create/dqlite/128-workers-4               107.8µ ± 1%
Delete/sqlite/1-workers-4                 408.3µ ± 1%
Delete/sqlite/4-workers-4                 150.3µ ± 1%
Delete/sqlite/16-workers-4                75.51µ ± 3%
Delete/sqlite/64-workers-4                51.48µ ± 3%
Delete/sqlite/128-workers-4               45.25µ ± 4%
Delete/dqlite/1-workers-4                 741.7µ ± 1%
Delete/dqlite/4-workers-4                 419.6µ ± 8%
Delete/dqlite/16-workers-4                196.0µ ± 2%
Delete/dqlite/64-workers-4                131.2µ ± 1%
Delete/dqlite/128-workers-4               120.7µ ± 1%
Get/sqlite-4                              332.3µ ± 2%
Get/dqlite-4                              448.9µ ± 2%
List/sqlite-tiny/all-4                    4.547µ ± 2%
List/sqlite-tiny/pagination-4             8.611µ ± 3%
List/sqlite-fits-in-page/all-4            7.312µ ± 2%
List/sqlite-fits-in-page/pagination-4     20.41µ ± 2%
List/sqlite-overflows-page/all-4          17.44µ ± 3%
List/sqlite-overflows-page/pagination-4   28.39µ ± 4%
List/dqlite-tiny/all-4                    4.015µ ± 1%
List/dqlite-tiny/pagination-4             7.217µ ± 1%
List/dqlite-fits-in-page/all-4            7.659µ ± 1%
List/dqlite-fits-in-page/pagination-4     17.93µ ± 1%
List/dqlite-overflows-page/all-4          20.95µ ± 5%
List/dqlite-overflows-page/pagination-4   27.54µ ± 1%
Update/sqlite/1-workers-4                 421.6µ ± 2%
Update/sqlite/4-workers-4                 153.7µ ± 2%
Update/sqlite/16-workers-4                73.35µ ± 3%
Update/sqlite/64-workers-4                50.06µ ± 3%
Update/sqlite/128-workers-4               43.65µ ± 3%
Update/dqlite/1-workers-4                 743.5µ ± 2%
Update/dqlite/4-workers-4                 420.2µ ± 2%
Update/dqlite/16-workers-4                206.3µ ± 1%
Update/dqlite/64-workers-4                136.6µ ± 5%
Update/dqlite/128-workers-4               119.5µ ± 1%
geomean                                   78.76µ

                                        │        After         │
                                        │ page-cache-misses/op │
Compaction/sqlite-4                               0.000 ± 0%
Compaction/dqlite-4                               0.000 ± 0%
Create/sqlite/1-workers-4                         0.000 ± 0%
Create/sqlite/4-workers-4                         0.000 ± 0%
Create/sqlite/16-workers-4                        0.000 ± 0%
Create/sqlite/64-workers-4                        0.000 ± 0%
Create/sqlite/128-workers-4                       0.000 ± 0%
Create/dqlite/1-workers-4                         0.000 ± 0%
Create/dqlite/4-workers-4                         0.000 ± 0%
Create/dqlite/16-workers-4                        0.000 ± 0%
Create/dqlite/64-workers-4                        0.000 ± 0%
Create/dqlite/128-workers-4                       0.000 ± 0%
Delete/sqlite/1-workers-4                         0.000 ± 0%
Delete/sqlite/4-workers-4                         0.000 ± 0%
Delete/sqlite/16-workers-4                        0.000 ± 0%
Delete/sqlite/64-workers-4                        0.000 ± 0%
Delete/sqlite/128-workers-4                       0.000 ± 0%
Delete/dqlite/1-workers-4                         0.000 ± 0%
Delete/dqlite/4-workers-4                         0.000 ± 0%
Delete/dqlite/16-workers-4                        0.000 ± 0%
Delete/dqlite/64-workers-4                        0.000 ± 0%
Delete/dqlite/128-workers-4                       0.000 ± 0%
Get/sqlite-4                                      0.000 ± 0%
Get/dqlite-4                                      0.000 ± 0%
List/sqlite-tiny/all-4                            0.000 ± 0%
List/sqlite-tiny/pagination-4                     0.000 ± 0%
List/sqlite-fits-in-page/all-4                    0.000 ± 0%
List/sqlite-fits-in-page/pagination-4             0.000 ± 0%
List/sqlite-overflows-page/all-4                  0.000 ± 0%
List/sqlite-overflows-page/pagination-4           0.000 ± 0%
List/dqlite-tiny/all-4                            0.000 ± 0%
List/dqlite-tiny/pagination-4                     0.000 ± 0%
List/dqlite-fits-in-page/all-4                    0.000 ± 0%
List/dqlite-fits-in-page/pagination-4             0.000 ± 0%
List/dqlite-overflows-page/all-4                  0.000 ± 0%
List/dqlite-overflows-page/pagination-4           0.000 ± 0%
Update/sqlite/1-workers-4                         0.000 ± 0%
Update/sqlite/4-workers-4                         0.000 ± 0%
Update/sqlite/16-workers-4                        0.000 ± 0%
Update/sqlite/64-workers-4                        0.000 ± 0%
Update/sqlite/128-workers-4                       0.000 ± 0%
Update/dqlite/1-workers-4                         0.000 ± 0%
Update/dqlite/4-workers-4                         0.000 ± 0%
Update/dqlite/16-workers-4                        0.000 ± 0%
Update/dqlite/64-workers-4                        0.000 ± 0%
Update/dqlite/128-workers-4                       0.000 ± 0%
geomean                                                      ¹
¹ summaries must be >0 to compute geomean

                                        │        After         │
                                        │ page-cache-spills/op │
Compaction/sqlite-4                               0.000 ± 0%
Compaction/dqlite-4                               0.000 ± 0%
Create/sqlite/1-workers-4                         0.000 ± 0%
Create/sqlite/4-workers-4                         0.000 ± 0%
Create/sqlite/16-workers-4                        0.000 ± 0%
Create/sqlite/64-workers-4                        0.000 ± 0%
Create/sqlite/128-workers-4                       0.000 ± 0%
Create/dqlite/1-workers-4                         0.000 ± 0%
Create/dqlite/4-workers-4                         0.000 ± 0%
Create/dqlite/16-workers-4                        0.000 ± 0%
Create/dqlite/64-workers-4                        0.000 ± 0%
Create/dqlite/128-workers-4                       0.000 ± 0%
Delete/sqlite/1-workers-4                         0.000 ± 0%
Delete/sqlite/4-workers-4                         0.000 ± 0%
Delete/sqlite/16-workers-4                        0.000 ± 0%
Delete/sqlite/64-workers-4                        0.000 ± 0%
Delete/sqlite/128-workers-4                       0.000 ± 0%
Delete/dqlite/1-workers-4                         0.000 ± 0%
Delete/dqlite/4-workers-4                         0.000 ± 0%
Delete/dqlite/16-workers-4                        0.000 ± 0%
Delete/dqlite/64-workers-4                        0.000 ± 0%
Delete/dqlite/128-workers-4                       0.000 ± 0%
Get/sqlite-4                                      0.000 ± 0%
Get/dqlite-4                                      0.000 ± 0%
List/sqlite-tiny/all-4                            0.000 ± 0%
List/sqlite-tiny/pagination-4                     0.000 ± 0%
List/sqlite-fits-in-page/all-4                    0.000 ± 0%
List/sqlite-fits-in-page/pagination-4             0.000 ± 0%
List/sqlite-overflows-page/all-4                  0.000 ± 0%
List/sqlite-overflows-page/pagination-4           0.000 ± 0%
List/dqlite-tiny/all-4                            0.000 ± 0%
List/dqlite-tiny/pagination-4                     0.000 ± 0%
List/dqlite-fits-in-page/all-4                    0.000 ± 0%
List/dqlite-fits-in-page/pagination-4             0.000 ± 0%
List/dqlite-overflows-page/all-4                  0.000 ± 0%
List/dqlite-overflows-page/pagination-4           0.000 ± 0%
Update/sqlite/1-workers-4                         0.000 ± 0%
Update/sqlite/4-workers-4                         0.000 ± 0%
Update/sqlite/16-workers-4                        0.000 ± 0%
Update/sqlite/64-workers-4                        0.000 ± 0%
Update/sqlite/128-workers-4                       0.000 ± 0%
Update/dqlite/1-workers-4                         0.000 ± 0%
Update/dqlite/4-workers-4                         0.000 ± 0%
Update/dqlite/16-workers-4                        0.000 ± 0%
Update/dqlite/64-workers-4                        0.000 ± 0%
Update/dqlite/128-workers-4                       0.000 ± 0%
geomean                                                      ¹
¹ summaries must be >0 to compute geomean

                                        │     After     │
                                        │ page-reads/op │
Compaction/sqlite-4                          15.06 ± 2%
Compaction/dqlite-4                          15.18 ± 1%
Create/sqlite/1-workers-4                    11.92 ± 0%
Create/sqlite/4-workers-4                    8.418 ± 0%
Create/sqlite/16-workers-4                   8.252 ± 0%
Create/sqlite/64-workers-4                   8.192 ± 0%
Create/sqlite/128-workers-4                  8.180 ± 0%
Create/dqlite/1-workers-4                    7.560 ± 3%
Create/dqlite/4-workers-4                    8.497 ± 0%
Create/dqlite/16-workers-4                   8.236 ± 0%
Create/dqlite/64-workers-4                   8.168 ± 0%
Create/dqlite/128-workers-4                  8.159 ± 0%
Delete/sqlite/1-workers-4                    14.48 ± 0%
Delete/sqlite/4-workers-4                    12.42 ± 1%
Delete/sqlite/16-workers-4                   14.82 ± 0%
Delete/sqlite/64-workers-4                   14.85 ± 0%
Delete/sqlite/128-workers-4                  14.87 ± 0%
Delete/dqlite/1-workers-4                    9.427 ± 1%
Delete/dqlite/4-workers-4                    11.04 ± 0%
Delete/dqlite/16-workers-4                   10.98 ± 5%
Delete/dqlite/64-workers-4                   12.91 ± 5%
Delete/dqlite/128-workers-4                  12.92 ± 0%
Get/sqlite-4                                 12.25 ± 0%
Get/dqlite-4                                 12.26 ± 0%
List/sqlite-tiny/all-4                      379.3m ± 0%
List/sqlite-tiny/pagination-4                1.319 ± 3%
List/sqlite-fits-in-page/all-4              323.4m ± 0%
List/sqlite-fits-in-page/pagination-4        1.125 ± 3%
List/sqlite-overflows-page/all-4            364.6m ± 0%
List/sqlite-overflows-page/pagination-4      1.260 ± 0%
List/dqlite-tiny/all-4                      377.4m ± 0%
List/dqlite-tiny/pagination-4                1.313 ± 3%
List/dqlite-fits-in-page/all-4              321.6m ± 0%
List/dqlite-fits-in-page/pagination-4        1.115 ± 0%
List/dqlite-overflows-page/all-4            361.0m ± 0%
List/dqlite-overflows-page/pagination-4      1.250 ± 0%
Update/sqlite/1-workers-4                    14.14 ± 0%
Update/sqlite/4-workers-4                    10.27 ± 0%
Update/sqlite/16-workers-4                   10.11 ± 0%
Update/sqlite/64-workers-4                   10.10 ± 0%
Update/sqlite/128-workers-4                  10.33 ± 1%
Update/dqlite/1-workers-4                    9.602 ± 2%
Update/dqlite/4-workers-4                    10.50 ± 0%
Update/dqlite/16-workers-4                   10.19 ± 0%
Update/dqlite/64-workers-4                   10.13 ± 0%
Update/dqlite/128-workers-4                  10.13 ± 0%
geomean                                      5.194

                                        │     After      │
                                        │ page-writes/op │
Compaction/sqlite-4                       84.43m ± 40%
Compaction/dqlite-4                       89.81m ± 27%
Create/sqlite/1-workers-4                  3.213 ±  0%
Create/sqlite/4-workers-4                  2.016 ±  1%
Create/sqlite/16-workers-4                742.8m ±  2%
Create/sqlite/64-workers-4                331.4m ±  4%
Create/sqlite/128-workers-4               237.9m ±  3%
Create/dqlite/1-workers-4                  3.191 ±  0%
Create/dqlite/4-workers-4                  1.705 ±  0%
Create/dqlite/16-workers-4                549.5m ±  2%
Create/dqlite/64-workers-4                203.5m ±  8%
Create/dqlite/128-workers-4               122.5m ±  3%
Delete/sqlite/1-workers-4                  3.274 ±  0%
Delete/sqlite/4-workers-4                  2.156 ±  3%
Delete/sqlite/16-workers-4                 1.032 ±  5%
Delete/sqlite/64-workers-4                603.4m ±  4%
Delete/sqlite/128-workers-4               501.8m ±  6%
Delete/dqlite/1-workers-4                  3.266 ±  1%
Delete/dqlite/4-workers-4                  1.779 ±  1%
Delete/dqlite/16-workers-4                628.0m ±  2%
Delete/dqlite/64-workers-4                272.7m ±  5%
Delete/dqlite/128-workers-4               192.7m ± 10%
Get/sqlite-4                               0.000 ±  0%
Get/dqlite-4                               0.000 ±  0%
List/sqlite-tiny/all-4                     0.000 ±  0%
List/sqlite-tiny/pagination-4              0.000 ±  0%
List/sqlite-fits-in-page/all-4             0.000 ±  0%
List/sqlite-fits-in-page/pagination-4      0.000 ±  0%
List/sqlite-overflows-page/all-4           0.000 ±  0%
List/sqlite-overflows-page/pagination-4    0.000 ±  0%
List/dqlite-tiny/all-4                     0.000 ±  0%
List/dqlite-tiny/pagination-4              0.000 ±  0%
List/dqlite-fits-in-page/all-4             0.000 ±  0%
List/dqlite-fits-in-page/pagination-4      0.000 ±  0%
List/dqlite-overflows-page/all-4           0.000 ±  0%
List/dqlite-overflows-page/pagination-4    0.000 ±  0%
Update/sqlite/1-workers-4                  3.420 ±  0%
Update/sqlite/4-workers-4                  2.504 ±  1%
Update/sqlite/16-workers-4                 1.551 ±  1%
Update/sqlite/64-workers-4                 1.105 ±  1%
Update/sqlite/128-workers-4               910.5m ±  2%
Update/dqlite/1-workers-4                  3.373 ±  0%
Update/dqlite/4-workers-4                  2.165 ±  1%
Update/dqlite/16-workers-4                 1.223 ±  3%
Update/dqlite/64-workers-4                700.7m ± 10%
Update/dqlite/128-workers-4               412.5m ±  9%
geomean                                                ¹
¹ summaries must be >0 to compute geomean

                                        │     After      │
                                        │ sec-reading/op │
Compaction/sqlite-4                         62.40µ ±  2%
Compaction/dqlite-4                         73.70µ ± 19%
Create/sqlite/1-workers-4                   34.30µ ± 17%
Create/sqlite/4-workers-4                   63.80µ ±  6%
Create/sqlite/16-workers-4                  34.90µ ±  6%
Create/sqlite/64-workers-4                  20.00µ ±  8%
Create/sqlite/128-workers-4                 16.80µ ±  4%
Create/dqlite/1-workers-4                   14.10µ ± 29%
Create/dqlite/4-workers-4                   11.90µ ± 51%
Create/dqlite/16-workers-4                  7.200µ ± 26%
Create/dqlite/64-workers-4                  3.300µ ± 18%
Create/dqlite/128-workers-4                 2.300µ ± 30%
Delete/sqlite/1-workers-4                   48.40µ ±  6%
Delete/sqlite/4-workers-4                   76.10µ ±  4%
Delete/sqlite/16-workers-4                  56.00µ ±  8%
Delete/sqlite/64-workers-4                  41.30µ ±  3%
Delete/sqlite/128-workers-4                 37.70µ ±  4%
Delete/dqlite/1-workers-4                   20.80µ ± 11%
Delete/dqlite/4-workers-4                   19.00µ ± 66%
Delete/dqlite/16-workers-4                  13.90µ ± 16%
Delete/dqlite/64-workers-4                  10.70µ ± 14%
Delete/dqlite/128-workers-4                 10.10µ ± 15%
Get/sqlite-4                                83.00µ ±  8%
Get/dqlite-4                                47.00µ ±  7%
List/sqlite-tiny/all-4                      10.00µ ±  2%
List/sqlite-tiny/pagination-4               18.00µ ±  2%
List/sqlite-fits-in-page/all-4              15.20µ ±  1%
List/sqlite-fits-in-page/pagination-4       37.60µ ±  2%
List/sqlite-overflows-page/all-4            33.10µ ±  2%
List/sqlite-overflows-page/pagination-4     52.10µ ±  2%
List/dqlite-tiny/all-4                      6.000µ ± 18%
List/dqlite-tiny/pagination-4               10.10µ ± 14%
List/dqlite-fits-in-page/all-4              13.60µ ± 14%
List/dqlite-fits-in-page/pagination-4       30.80µ ±  8%
List/dqlite-overflows-page/all-4            36.90µ ±  3%
List/dqlite-overflows-page/pagination-4     49.20µ ±  3%
Update/sqlite/1-workers-4                   33.80µ ± 11%
Update/sqlite/4-workers-4                   68.30µ ±  4%
Update/sqlite/16-workers-4                  41.60µ ±  3%
Update/sqlite/64-workers-4                  26.20µ ±  6%
Update/sqlite/128-workers-4                 20.60µ ± 12%
Update/dqlite/1-workers-4                   15.00µ ± 23%
Update/dqlite/4-workers-4                   12.00µ ± 21%
Update/dqlite/16-workers-4                  8.700µ ± 23%
Update/dqlite/64-workers-4                  4.500µ ± 31%
Update/dqlite/128-workers-4                 3.200µ ± 16%
geomean                                     21.07µ

                                        │     After      │
                                        │ sec-writing/op │
Compaction/sqlite-4                       16.30µ ±  2%
Compaction/dqlite-4                       12.10µ ± 13%
Create/sqlite/1-workers-4                 187.9µ ±  5%
Create/sqlite/4-workers-4                 72.70µ ±  5%
Create/sqlite/16-workers-4                24.80µ ±  9%
Create/sqlite/64-workers-4                16.90µ ±  4%
Create/sqlite/128-workers-4               15.10µ ±  8%
Create/dqlite/1-workers-4                 40.80µ ± 19%
Create/dqlite/4-workers-4                 28.80µ ± 31%
Create/dqlite/16-workers-4                17.20µ ± 12%
Create/dqlite/64-workers-4                15.00µ ± 14%
Create/dqlite/128-workers-4               13.90µ ± 14%
Delete/sqlite/1-workers-4                 175.1µ ±  6%
Delete/sqlite/4-workers-4                 76.70µ ±  3%
Delete/sqlite/16-workers-4                28.40µ ±  8%
Delete/sqlite/64-workers-4                20.30µ ±  5%
Delete/sqlite/128-workers-4               18.60µ ±  3%
Delete/dqlite/1-workers-4                 42.20µ ± 60%
Delete/dqlite/4-workers-4                 35.10µ ± 19%
Delete/dqlite/16-workers-4                22.40µ ± 21%
Delete/dqlite/64-workers-4                16.30µ ± 15%
Delete/dqlite/128-workers-4               16.60µ ± 10%
Get/sqlite-4                               0.000 ±  0%
Get/dqlite-4                               0.000 ±  0%
List/sqlite-tiny/all-4                     0.000 ±  0%
List/sqlite-tiny/pagination-4              0.000 ±  0%
List/sqlite-fits-in-page/all-4             0.000 ±  0%
List/sqlite-fits-in-page/pagination-4      0.000 ±  0%
List/sqlite-overflows-page/all-4           0.000 ±  0%
List/sqlite-overflows-page/pagination-4    0.000 ±  0%
List/dqlite-tiny/all-4                     0.000 ±  0%
List/dqlite-tiny/pagination-4              0.000 ±  0%
List/dqlite-fits-in-page/all-4             0.000 ±  0%
List/dqlite-fits-in-page/pagination-4      0.000 ±  0%
List/dqlite-overflows-page/all-4           0.000 ±  0%
List/dqlite-overflows-page/pagination-4    0.000 ±  0%
Update/sqlite/1-workers-4                 182.7µ ±  4%
Update/sqlite/4-workers-4                 73.60µ ±  3%
Update/sqlite/16-workers-4                24.90µ ±  8%
Update/sqlite/64-workers-4                17.80µ ±  5%
Update/sqlite/128-workers-4               16.20µ ±  5%
Update/dqlite/1-workers-4                 40.20µ ± 25%
Update/dqlite/4-workers-4                 34.20µ ± 21%
Update/dqlite/16-workers-4                20.00µ ± 15%
Update/dqlite/64-workers-4                15.40µ ± 14%
Update/dqlite/128-workers-4               15.50µ ± 21%
geomean                                                ¹
¹ summaries must be >0 to compute geomean

                                        │     After     │
                                        │     B/op      │
Compaction/sqlite-4                       3.092Ki ±  6%
Compaction/dqlite-4                       13.75Ki ±  0%
Create/sqlite/1-workers-4                 21.66Ki ±  0%
Create/sqlite/4-workers-4                 19.90Ki ±  0%
Create/sqlite/16-workers-4                17.99Ki ±  0%
Create/sqlite/64-workers-4                17.44Ki ±  0%
Create/sqlite/128-workers-4               17.35Ki ±  0%
Create/dqlite/1-workers-4                 20.79Ki ±  0%
Create/dqlite/4-workers-4                 18.06Ki ±  5%
Create/dqlite/16-workers-4                17.30Ki ±  0%
Create/dqlite/64-workers-4                16.90Ki ±  0%
Create/dqlite/128-workers-4               16.84Ki ±  0%
Delete/sqlite/1-workers-4                 24.27Ki ±  0%
Delete/sqlite/4-workers-4                 22.54Ki ±  0%
Delete/sqlite/16-workers-4                20.65Ki ±  0%
Delete/sqlite/64-workers-4                20.15Ki ±  0%
Delete/sqlite/128-workers-4               20.07Ki ±  0%
Delete/dqlite/1-workers-4                 23.36Ki ±  0%
Delete/dqlite/4-workers-4                 20.51Ki ±  5%
Delete/dqlite/16-workers-4                19.79Ki ±  0%
Delete/dqlite/64-workers-4                19.41Ki ±  0%
Delete/dqlite/128-workers-4               19.36Ki ±  0%
Get/sqlite-4                              22.87Ki ±  0%
Get/dqlite-4                              21.76Ki ±  0%
List/sqlite-tiny/all-4                    1.271Ki ±  5%
List/sqlite-tiny/pagination-4             1.757Ki ±  3%
List/sqlite-fits-in-page/all-4            6.532Ki ±  7%
List/sqlite-fits-in-page/pagination-4     8.305Ki ±  4%
List/sqlite-overflows-page/all-4          33.74Ki ±  8%
List/sqlite-overflows-page/pagination-4   36.93Ki ±  3%
List/dqlite-tiny/all-4                    1.003Ki ±  7%
List/dqlite-tiny/pagination-4             1.007Ki ±  2%
List/dqlite-fits-in-page/all-4            5.831Ki ±  9%
List/dqlite-fits-in-page/pagination-4     5.963Ki ±  3%
List/dqlite-overflows-page/all-4          29.03Ki ± 11%
List/dqlite-overflows-page/pagination-4   29.35Ki ±  1%
Update/sqlite/1-workers-4                 22.80Ki ±  0%
Update/sqlite/4-workers-4                 21.03Ki ±  0%
Update/sqlite/16-workers-4                19.08Ki ±  0%
Update/sqlite/64-workers-4                18.54Ki ±  0%
Update/sqlite/128-workers-4               18.45Ki ±  0%
Update/dqlite/1-workers-4                 21.86Ki ±  0%
Update/dqlite/4-workers-4                 19.09Ki ±  1%
Update/dqlite/16-workers-4                18.42Ki ±  0%
Update/dqlite/64-workers-4                18.03Ki ±  0%
Update/dqlite/128-workers-4               17.97Ki ±  0%
geomean                                   14.00Ki

                                        │    After    │
                                        │  allocs/op  │
Compaction/sqlite-4                       45.00 ±  7%
Compaction/dqlite-4                       211.0 ±  0%
Create/sqlite/1-workers-4                 406.0 ±  0%
Create/sqlite/4-workers-4                 366.0 ±  0%
Create/sqlite/16-workers-4                317.0 ±  0%
Create/sqlite/64-workers-4                301.0 ±  0%
Create/sqlite/128-workers-4               298.0 ±  0%
Create/dqlite/1-workers-4                 378.0 ±  0%
Create/dqlite/4-workers-4                 322.0 ±  6%
Create/dqlite/16-workers-4                302.0 ±  0%
Create/dqlite/64-workers-4                292.0 ±  0%
Create/dqlite/128-workers-4               290.0 ±  0%
Delete/sqlite/1-workers-4                 432.0 ±  0%
Delete/sqlite/4-workers-4                 392.0 ±  0%
Delete/sqlite/16-workers-4                343.0 ±  0%
Delete/sqlite/64-workers-4                328.0 ±  0%
Delete/sqlite/128-workers-4               326.0 ±  0%
Delete/dqlite/1-workers-4                 403.0 ±  0%
Delete/dqlite/4-workers-4                 345.0 ±  6%
Delete/dqlite/16-workers-4                327.0 ±  0%
Delete/dqlite/64-workers-4                317.0 ±  0%
Delete/dqlite/128-workers-4               315.0 ±  0%
Get/sqlite-4                              398.0 ±  0%
Get/dqlite-4                              377.0 ±  0%
List/sqlite-tiny/all-4                    15.00 ±  7%
List/sqlite-tiny/pagination-4             22.00 ±  5%
List/sqlite-fits-in-page/all-4            17.00 ±  0%
List/sqlite-fits-in-page/pagination-4     34.00 ±  0%
List/sqlite-overflows-page/all-4          22.00 ±  5%
List/sqlite-overflows-page/pagination-4   34.00 ±  0%
List/dqlite-tiny/all-4                    10.00 ± 10%
List/dqlite-tiny/pagination-4             11.00 ±  0%
List/dqlite-fits-in-page/all-4            15.00 ±  7%
List/dqlite-fits-in-page/pagination-4     16.00 ±  0%
List/dqlite-overflows-page/all-4          26.00 ± 12%
List/dqlite-overflows-page/pagination-4   26.00 ±  4%
Update/sqlite/1-workers-4                 413.0 ±  0%
Update/sqlite/4-workers-4                 372.0 ±  0%
Update/sqlite/16-workers-4                323.0 ±  0%
Update/sqlite/64-workers-4                308.0 ±  0%
Update/sqlite/128-workers-4               305.0 ±  0%
Update/dqlite/1-workers-4                 385.0 ±  0%
Update/dqlite/4-workers-4                 327.0 ±  2%
Update/dqlite/16-workers-4                308.0 ±  0%
Update/dqlite/64-workers-4                299.0 ±  0%
Update/dqlite/128-workers-4               297.0 ±  0%
geomean                                   151.8

                                        │         After         │
                                        │ network-bytes-read/op │
Compaction/dqlite-4                               4.195Ki ±  0%
Create/dqlite/1-workers-4                           243.1 ±  0%
Create/dqlite/4-workers-4                           171.5 ± 22%
Create/dqlite/16-workers-4                          147.4 ±  0%
Create/dqlite/64-workers-4                          133.9 ±  1%
Create/dqlite/128-workers-4                         132.2 ±  1%
Delete/dqlite/1-workers-4                           721.7 ±  2%
Delete/dqlite/4-workers-4                           648.6 ±  5%
Delete/dqlite/16-workers-4                          625.7 ±  1%
Delete/dqlite/64-workers-4                          615.9 ±  0%
Delete/dqlite/128-workers-4                         615.3 ±  1%
Get/dqlite-4                                        820.4 ±  1%
List/dqlite-tiny/all-4                              167.6 ±  2%
List/dqlite-tiny/pagination-4                       176.1 ±  2%
List/dqlite-fits-in-page/all-4                    1.212Ki ±  2%
List/dqlite-fits-in-page/pagination-4             1.315Ki ±  2%
List/dqlite-overflows-page/all-4                  6.490Ki ± 11%
List/dqlite-overflows-page/pagination-4           6.604Ki ±  4%
Update/dqlite/1-workers-4                           263.2 ±  0%
Update/dqlite/4-workers-4                           185.8 ±  6%
Update/dqlite/16-workers-4                          164.5 ±  0%
Update/dqlite/64-workers-4                          150.9 ±  0%
Update/dqlite/128-workers-4                         149.0 ±  1%
geomean                                             459.5

                                        │          After           │
                                        │ network-bytes-written/op │
Compaction/dqlite-4                                    5.680 ±  1%
Create/dqlite/1-workers-4                              128.5 ±  0%
Create/dqlite/4-workers-4                              112.6 ± 17%
Create/dqlite/16-workers-4                             99.04 ±  0%
Create/dqlite/64-workers-4                             90.85 ±  0%
Create/dqlite/128-workers-4                            90.91 ±  2%
Delete/dqlite/1-workers-4                              90.06 ±  0%
Delete/dqlite/4-workers-4                              71.31 ± 30%
Delete/dqlite/16-workers-4                             59.44 ±  0%
Delete/dqlite/64-workers-4                             51.17 ±  0%
Delete/dqlite/128-workers-4                            49.85 ±  0%
Get/dqlite-4                                           105.2 ±  0%
List/dqlite-tiny/all-4                               0.04311 ±  5%
List/dqlite-tiny/pagination-4                        0.06329 ±  6%
List/dqlite-fits-in-page/all-4                       0.06382 ±  5%
List/dqlite-fits-in-page/pagination-4                 0.1163 ±  7%
List/dqlite-overflows-page/all-4                     0.09423 ± 14%
List/dqlite-overflows-page/pagination-4               0.1567 ±  4%
Update/dqlite/1-workers-4                              152.7 ±  0%
Update/dqlite/4-workers-4                              134.6 ±  4%
Update/dqlite/16-workers-4                             123.1 ±  0%
Update/dqlite/64-workers-4                             114.8 ±  0%
Update/dqlite/128-workers-4                            113.5 ±  0%
geomean                                                13.28

@louiseschmidtgen
louiseschmidtgen merged commit 38fd785 into feat/microk8s-integration-tests Jun 11, 2026
9 of 11 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant