Skip to content

Conversation

@tigrannajaryan
Copy link
Collaborator

Run make prepver VERSION=v0.0.9 as require by
https://github.com/splunk/stef/blob/main/CONTRIBUTING.md#releasing

@github-actions
Copy link

github-actions bot commented Dec 7, 2025

Benchmark Result

Benchmark diff with base branch
goos: linux
goarch: amd64
pkg: github.com/splunk/stef/benchmarks
cpu: AMD EPYC 7763 64-Core Processor                
                                                 │ bench-main.txt │            bench-new.txt            │
                                                 │     sec/op     │    sec/op     vs base               │
SerializeNative/STEF/serialize-4                     12.16m ± 13%   12.01m ± 13%        ~ (p=0.818 n=6)
SerializeNative/STEFU/serialize-4                    34.49m ±  2%   35.69m ±  3%   +3.47% (p=0.002 n=6)
DeserializeNative/STEF/deser-4                       2.469m ±  2%   2.450m ±  0%        ~ (p=0.240 n=6)
DeserializeNative/STEFU/deser-4                      7.372m ±  2%   7.358m ±  3%        ~ (p=0.485 n=6)
SerializeFromPdata/STEF/serialize-4                  138.0m ±  3%   137.8m ±  2%        ~ (p=0.818 n=6)
SerializeFromPdata/STEFU/serialize-4                 34.66m ±  0%   35.85m ±  1%   +3.43% (p=0.002 n=6)
DeserializeToPdata/STEF/deserialize-4                46.90m ±  2%   46.94m ±  2%        ~ (p=0.699 n=6)
DeserializeToPdata/STEFU/deserialize-4               64.38m ±  2%   64.07m ±  2%        ~ (p=0.180 n=6)
STEFReaderRead-4                                     2.494m ±  2%   2.518m ±  2%        ~ (p=0.065 n=6)
STEFSerializeMultipart/astronomy-otelmetrics-4        3.471 ± 20%    3.455 ± 20%        ~ (p=0.485 n=6)
STEFDeserializeMultipart/astronomy-otelmetrics-4     76.45m ± 13%   83.38m ± 13%        ~ (p=0.937 n=6)
ReadSTEF-4                                           2.643m ±  1%   2.585m ±  1%   -2.23% (p=0.004 n=6)
ReadSTEFZ-4                                          3.787m ±  4%   3.181m ±  1%  -16.02% (p=0.002 n=6)
ReadSTEFZWriteSTEF-4                                 8.094m ±  4%   7.578m ±  1%   -6.38% (p=0.002 n=6)
geomean                                              21.92m         21.72m         -0.93%

                                                 │ bench-main.txt │            bench-new.txt             │
                                                 │   sec/point    │   sec/point    vs base               │
SerializeNative/STEF/serialize-4                     181.9n ± 13%    179.6n ± 13%        ~ (p=0.818 n=6)
SerializeNative/STEFU/serialize-4                    516.0n ±  2%    533.9n ±  3%   +3.47% (p=0.002 n=6)
DeserializeNative/STEF/deser-4                       36.92n ±  2%    36.64n ±  0%        ~ (p=0.240 n=6)
DeserializeNative/STEFU/deser-4                      110.2n ±  2%    110.0n ±  3%        ~ (p=0.554 n=6)
SerializeFromPdata/STEF/serialize-4                  2.065µ ±  3%    2.062µ ±  2%        ~ (p=0.732 n=6)
SerializeFromPdata/STEFU/serialize-4                 518.3n ±  0%    536.1n ±  1%   +3.43% (p=0.002 n=6)
DeserializeToPdata/STEF/deserialize-4                701.6n ±  2%    702.1n ±  2%        ~ (p=0.563 n=6)
DeserializeToPdata/STEFU/deserialize-4               962.9n ±  2%    958.4n ±  2%        ~ (p=0.145 n=6)
STEFReaderRead-4                                     37.29n ±  2%    37.66n ±  2%        ~ (p=0.065 n=6)
STEFSerializeMultipart/astronomy-otelmetrics-4       4.412µ ± 20%    4.392µ ± 20%        ~ (p=0.485 n=6)
STEFDeserializeMultipart/astronomy-otelmetrics-4     97.19n ± 13%   105.95n ± 13%        ~ (p=0.855 n=6)
ReadSTEF-4                                           39.57n ±  1%    38.68n ±  1%   -2.24% (p=0.004 n=6)
ReadSTEFZ-4                                          56.68n ±  4%    47.60n ±  1%  -16.02% (p=0.002 n=6)
ReadSTEFZWriteSTEF-4                                 121.1n ±  4%    113.4n ±  1%   -6.36% (p=0.002 n=6)
geomean                                              230.6n          228.4n         -0.94%

                                                 │ bench-main.txt │            bench-new.txt             │
                                                 │      B/op      │     B/op      vs base                │
SerializeNative/STEF/serialize-4                     3.349Mi ± 0%   3.348Mi ± 0%       ~ (p=0.485 n=6)
SerializeNative/STEFU/serialize-4                    7.530Mi ± 0%   7.530Mi ± 0%       ~ (p=0.909 n=6)
DeserializeNative/STEF/deser-4                       934.4Ki ± 0%   934.4Ki ± 0%       ~ (p=1.000 n=6) ¹
DeserializeNative/STEFU/deser-4                      1.471Mi ± 0%   1.471Mi ± 0%       ~ (p=1.000 n=6)
SerializeFromPdata/STEF/serialize-4                  74.82Mi ± 0%   74.82Mi ± 0%       ~ (p=0.619 n=6)
SerializeFromPdata/STEFU/serialize-4                 7.530Mi ± 0%   7.530Mi ± 0%       ~ (p=0.699 n=6)
DeserializeToPdata/STEF/deserialize-4                31.97Mi ± 0%   31.97Mi ± 0%       ~ (p=0.682 n=6)
DeserializeToPdata/STEFU/deserialize-4               38.64Mi ± 0%   38.64Mi ± 0%       ~ (p=1.000 n=6)
STEFReaderRead-4                                     936.2Ki ± 0%   936.2Ki ± 0%       ~ (p=1.000 n=6) ¹
STEFSerializeMultipart/astronomy-otelmetrics-4       3.361Gi ± 0%   3.363Gi ± 0%       ~ (p=0.240 n=6)
STEFDeserializeMultipart/astronomy-otelmetrics-4     20.41Mi ± 0%   20.41Mi ± 0%       ~ (p=0.829 n=6)
ReadSTEF-4                                           936.2Ki ± 0%   936.2Ki ± 0%  +0.00% (p=0.024 n=6)
ReadSTEFZ-4                                          10.27Mi ± 0%   10.27Mi ± 0%       ~ (p=0.297 n=6)
ReadSTEFZWriteSTEF-4                                 13.43Mi ± 0%   13.43Mi ± 0%       ~ (p=0.385 n=6)
geomean                                              10.47Mi        10.47Mi       +0.00%
¹ all samples are equal

                                                 │ bench-main.txt │            bench-new.txt            │
                                                 │   allocs/op    │  allocs/op   vs base                │
SerializeNative/STEF/serialize-4                      2.667k ± 1%   2.663k ± 0%       ~ (p=0.359 n=6)
SerializeNative/STEFU/serialize-4                      884.5 ± 0%    885.0 ± 0%       ~ (p=1.000 n=6)
DeserializeNative/STEF/deser-4                         465.0 ± 0%    465.0 ± 0%       ~ (p=1.000 n=6) ¹
DeserializeNative/STEFU/deser-4                        469.0 ± 0%    469.0 ± 0%       ~ (p=1.000 n=6) ¹
SerializeFromPdata/STEF/serialize-4                   134.7k ± 0%   134.7k ± 0%       ~ (p=0.281 n=6)
SerializeFromPdata/STEFU/serialize-4                   886.0 ± 0%    886.0 ± 0%       ~ (p=1.000 n=6) ¹
DeserializeToPdata/STEF/deserialize-4                 756.2k ± 0%   756.2k ± 0%       ~ (p=1.000 n=6) ¹
DeserializeToPdata/STEFU/deserialize-4                944.9k ± 0%   944.9k ± 0%       ~ (p=1.000 n=6) ¹
STEFReaderRead-4                                       465.0 ± 0%    465.0 ± 0%       ~ (p=1.000 n=6) ¹
STEFSerializeMultipart/astronomy-otelmetrics-4        13.15M ± 0%   13.15M ± 0%  -0.00% (p=0.032 n=6)
STEFDeserializeMultipart/astronomy-otelmetrics-4      2.294k ± 0%   2.294k ± 0%       ~ (p=1.000 n=6) ¹
ReadSTEF-4                                             466.0 ± 0%    466.0 ± 0%       ~ (p=1.000 n=6) ¹
ReadSTEFZ-4                                            503.0 ± 0%    503.0 ± 0%       ~ (p=1.000 n=6)
ReadSTEFZWriteSTEF-4                                  1.233k ± 0%   1.233k ± 0%       ~ (p=0.455 n=6)
geomean                                               6.362k        6.361k       -0.01%
¹ all samples are equal
Benchmark result
benchstat bench-new.txt
goos: linux
goarch: amd64
pkg: github.com/splunk/stef/benchmarks
cpu: AMD EPYC 7763 64-Core Processor                
                                                 │ bench-new.txt │
                                                 │    sec/op     │
SerializeNative/STEF/serialize-4                    12.01m ± 13%
SerializeNative/STEFU/serialize-4                   35.69m ±  3%
DeserializeNative/STEF/deser-4                      2.450m ±  0%
DeserializeNative/STEFU/deser-4                     7.358m ±  3%
SerializeFromPdata/STEF/serialize-4                 137.8m ±  2%
SerializeFromPdata/STEFU/serialize-4                35.85m ±  1%
DeserializeToPdata/STEF/deserialize-4               46.94m ±  2%
DeserializeToPdata/STEFU/deserialize-4              64.07m ±  2%
STEFReaderRead-4                                    2.518m ±  2%
STEFSerializeMultipart/astronomy-otelmetrics-4       3.455 ± 20%
STEFDeserializeMultipart/astronomy-otelmetrics-4    83.38m ± 13%
ReadSTEF-4                                          2.585m ±  1%
ReadSTEFZ-4                                         3.181m ±  1%
ReadSTEFZWriteSTEF-4                                7.578m ±  1%
geomean                                             21.72m

                                                 │ bench-new.txt │
                                                 │   sec/point   │
SerializeNative/STEF/serialize-4                    179.6n ± 13%
SerializeNative/STEFU/serialize-4                   533.9n ±  3%
DeserializeNative/STEF/deser-4                      36.64n ±  0%
DeserializeNative/STEFU/deser-4                     110.0n ±  3%
SerializeFromPdata/STEF/serialize-4                 2.062µ ±  2%
SerializeFromPdata/STEFU/serialize-4                536.1n ±  1%
DeserializeToPdata/STEF/deserialize-4               702.1n ±  2%
DeserializeToPdata/STEFU/deserialize-4              958.4n ±  2%
STEFReaderRead-4                                    37.66n ±  2%
STEFSerializeMultipart/astronomy-otelmetrics-4      4.392µ ± 20%
STEFDeserializeMultipart/astronomy-otelmetrics-4    105.9n ± 13%
ReadSTEF-4                                          38.68n ±  1%
ReadSTEFZ-4                                         47.60n ±  1%
ReadSTEFZWriteSTEF-4                                113.4n ±  1%
geomean                                             228.4n

                                                 │ bench-new.txt │
                                                 │     B/op      │
SerializeNative/STEF/serialize-4                    3.348Mi ± 0%
SerializeNative/STEFU/serialize-4                   7.530Mi ± 0%
DeserializeNative/STEF/deser-4                      934.4Ki ± 0%
DeserializeNative/STEFU/deser-4                     1.471Mi ± 0%
SerializeFromPdata/STEF/serialize-4                 74.82Mi ± 0%
SerializeFromPdata/STEFU/serialize-4                7.530Mi ± 0%
DeserializeToPdata/STEF/deserialize-4               31.97Mi ± 0%
DeserializeToPdata/STEFU/deserialize-4              38.64Mi ± 0%
STEFReaderRead-4                                    936.2Ki ± 0%
STEFSerializeMultipart/astronomy-otelmetrics-4      3.363Gi ± 0%
STEFDeserializeMultipart/astronomy-otelmetrics-4    20.41Mi ± 0%
ReadSTEF-4                                          936.2Ki ± 0%
ReadSTEFZ-4                                         10.27Mi ± 0%
ReadSTEFZWriteSTEF-4                                13.43Mi ± 0%
geomean                                             10.47Mi

                                                 │ bench-new.txt │
                                                 │   allocs/op   │
SerializeNative/STEF/serialize-4                     2.663k ± 0%
SerializeNative/STEFU/serialize-4                     885.0 ± 0%
DeserializeNative/STEF/deser-4                        465.0 ± 0%
DeserializeNative/STEFU/deser-4                       469.0 ± 0%
SerializeFromPdata/STEF/serialize-4                  134.7k ± 0%
SerializeFromPdata/STEFU/serialize-4                  886.0 ± 0%
DeserializeToPdata/STEF/deserialize-4                756.2k ± 0%
DeserializeToPdata/STEFU/deserialize-4               944.9k ± 0%
STEFReaderRead-4                                      465.0 ± 0%
STEFSerializeMultipart/astronomy-otelmetrics-4       13.15M ± 0%
STEFDeserializeMultipart/astronomy-otelmetrics-4     2.294k ± 0%
ReadSTEF-4                                            466.0 ± 0%
ReadSTEFZ-4                                           503.0 ± 0%
ReadSTEFZWriteSTEF-4                                 1.233k ± 0%
geomean                                              6.361k

@tigrannajaryan tigrannajaryan merged commit 3b29624 into main Dec 8, 2025
9 checks passed
@tigrannajaryan tigrannajaryan deleted the tigran/release-v009 branch December 8, 2025 17:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants