Please benchmark against latest zlib

[Snowiiii]

Hello, I saw that on the README there is a benchmark where zstd will be compared against zlib 1.2.11. I would appreciate if you would compare zstd against the latest zlib (1.3.1)

[Cyan4973]

We are using lzbench for the benchmarks,

the last commit of lzbench supports zlib v1.2.11,
which is directly bundled in the source tree.

The easiest solution for us would be for lzbench to update its support for zlib v1.3.1.
Then we could report the updated results.

From the changelog description, we don't anticipate any measurable performance difference between these 2 versions.
Mainly some bug fixes.

[Snowiiii]

Hey, Thanks for the quick response. It looks like lzbench is dead tbh. We may should consider a different benchmarking tool

[Adenilson]

Details may be a bit hazy since it was way back in April 2022 (i.e. 2 years and 8 months ago) when I last measured, but I recall that zlib 1.2.12 featured a faster CRC-32 checksum using the Kadatch-Jenkins algorithm.

That helped performance in general in zlib, something like +30% faster decompression in canonical zlib (i.e. Mark Adler's zlib).

That being said, zstd should still be many times faster.

[Adenilson]

@op: Here some data comparing zlib 1.2.11 vs 1.2.12 (and 1.3 will feature the very same Kadatch-Jenkins CRC-32) running in a Xeon processor:
https://issues.chromium.org/issues/40050946#comment62

[tansy]

For zlib-1.3.1 refer to branch zlib-1.3.1.

Can be cloned:
git clone --branch <branch> <remote-repository>
where branch = zlib-1.3.1.

It will do until maintainer updates compressors and released new version.

[Cyan4973]

arf, a pity that latest lzbench release v1.9 did not updated zlib using this feature branch.

Anyway, I could nonetheless test your branch, as PR160, and I note that the latest version of zlib v1.3.1 has a slightly faster level 1 compression speed without losing any compression ratio. Nice improvement!

[inikep]

@Cyan4973 We are working on lzbench 2.0 at https://github.com/inikep/lzbench/commits/update/
lzbench 1.9 is just a snapshot of compressors added/updated in last years.

[Cyan4973]

@Cyan4973 We are working on lzbench 2.0 at https://github.com/inikep/lzbench/commits/update/ lzbench 1.9 is just a snapshot of compressors added/updated in last years.

Great news @inikep !

[tansy]

and I note that the latest version of zlib v1.3.1 has a slightly faster level 1 compression speed without losing any compression ratio. Nice improvement!

Not for me, I mean in my case it is 1.6-0.8% slower compression, and 0.8-0% faster decompression.

Anyway, you can test this 'release candidate' (MD5 (lzbench-1.9.1-rc2-1_9aebd31e.tar.bz2) = 93f410d7b1045fadcc39b68a42c1a177) with updated dodecs: libdeflate-1.23, lz4-1.9.4, lzlib-1.15, zlib-1.3.1, zstd-1.5.6.

[Cyan4973]

benchmarks updated