-
Notifications
You must be signed in to change notification settings - Fork 2.4k
v1.5.7 #4298
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
v1.5.7 #4298
Changes from all commits
Commits
Show all changes
529 commits
Select commit
Hold shift + click to select a range
a224572
codemod: seqStore_t -> SeqStore_t
Cyan4973 8d4506b
codemod: ZSTD_sequenceLength -> ZSTD_SequenceLength
Cyan4973 477a010
codemod: symbolEncodingType_e -> SymbolEncodingType_e
Cyan4973 0442e43
codemod: ZSTD_defaultPolicy_e -> ZSTD_DefaultPolicy_e
Cyan4973 e9f8a11
ZSTD_entropyCompressSeqStore_internal() can accept an externally defi…
Cyan4973 0165eeb
created ZSTD_entropyCompressSeqStore_wExtLitBuffer()
Cyan4973 c97522f
codemod: ZSTD_sequenceFormat_e -> ZSTD_SequenceFormat_e
Cyan4973 894ea31
codemod: ZSTD_sequenceCopier -> ZSTD_SequenceCopier_f
Cyan4973 1ac79ba
minor: simplify ZSTD_selectSequenceCopier
Cyan4973 76dd3a9
scope: ZSTD_copySequencesToSeqStore*() are private to ZSTD_compress.c
Cyan4973 03d95f9
fix proper type for .forceNonContiguous
Cyan4973 5359d16
enable proper type
Cyan4973 30671d7
codemod: ZSTD_sequencePosition -> ZSTD_SequencePosition
Cyan4973 fa46894
codemod: ZSTD_buildSeqStore_e -> ZSTD_BuildSeqStore_e
Cyan4973 5df80ac
codemod: ZSTD_matchState_t -> ZSTD_MatchState_t
Cyan4973 41c667c
codemod: repcodes_t -> Repcodes_t
Cyan4973 25bef24
codemod: rawSeqStore_t -> RawSeqStore_t
Cyan4973 08edecb
codemod: ZSTD_blockCompressor -> ZSTD_BlockCompressor_f
Cyan4973 e0f3aae
doc: add mention of frame checksum incompatibility
Cyan4973 2503b64
fix minor artifact error in single_file_lib
Cyan4973 13b9296
minor simplification
Cyan4973 56cfb78
codemod: ZSTD_paramSwitch_e -> ZSTD_ParamSwitch_e
Cyan4973 4ef9d7d
codemod: ZSTD_cParamMode_e -> ZSTD_CParamMode_e
Cyan4973 047db4f
ZSTD_SequenceCopier_f no returns the nb of bytes consumed from input
Cyan4973 bcb1509
minor: more accurate variable scope
Cyan4973 14a21e4
produced ZSTD_compressSequencesAndLiterals() as a separate pipeline
Cyan4973 0b013b2
added unit tests to ZSTD_compressSequencesAndLiterals()
Cyan4973 09964c6
prepare fullbench for a refactor
Cyan4973 4c097b4
refactor fullbench
Cyan4973 c540976
minor: test reordering
Cyan4973 8b7e1b7
minor variable renaming
Cyan4973 c050ae4
fullbench: preparation functions are now in charge of allocating buffers
Cyan4973 8ab0409
add the compressSequences() benchmark scenario
Cyan4973 ac05ea8
fullbench: switch default generator to lorem ipsum
Cyan4973 f281497
fullbench: new scenario: compressSequencesAndLiterals()
Cyan4973 0a5c080
minor conversion warning fix
Cyan4973 1c8f5b0
minor optimization for ZSTD_compressSequencesAndLiterals()
Cyan4973 f176514
minor doc update
Cyan4973 a288751
minor optimization: only track seqPos->posInSrc when validateSequence…
Cyan4973 1f6d681
optimization: instantiate specialized version without Sequence checki…
Cyan4973 d2d0fda
updated documentation on validateSequence
Cyan4973 ca8bd83
minor: cleaner function parameter repcodeResolution
Cyan4973 5164d44
change advanced parameter name: ZSTD_c_repcodeResolution
Cyan4973 31b5ef2
ZSTD_compressSequencesAndLiterals() now supports multi-blocks frames.
Cyan4973 f0d0d95
added tests
Cyan4973 6f8c104
update Visual Studio solutions
Cyan4973 47edd0a
removed fullbench-dll project from visual solutions
Cyan4973 f617e86
fixed incorrect assert
Cyan4973 61ac831
attempt to silence Visual Studio warning about fopen()
Cyan4973 d48e330
change name to ZSTD_convertSequences*()
Cyan4973 95ad9e4
added benchmark for ZSTD_convertBlockSequences_wBlockDelim()
Cyan4973 12c47d3
improved speed of the Sequences converter
Cyan4973 b7b4e86
fixed minor conversion warning
Cyan4973 ad023b3
fixed minor error in one benchmark scenario
Cyan4973 0a54f6f
ZSTD_compressSequencesAndLiterals requires srcSize as parameter
Cyan4973 a80f55f
added a test for ZSTD_compressSequencesAndLiterals
Cyan4973 b339eff
add dedicated error code for special case
Cyan4973 ab0f179
ensure that srcSize is controlled
Cyan4973 52a9bc6
fixed minor error in preparation of one fullbench scenario
Cyan4973 76445bb
add a check, to return an error if Sequence validation is enabled
Cyan4973 b7a9e69
added parameter litCapacity
Cyan4973 522adc3
minor: use MEM_writeLE24()
Cyan4973 47cbfc8
restore invocation of ZSTD_entropyCompressSeqStore()
Cyan4973 f0937b8
[cmake] Fix -z noexecstack portability
terrelln f8725e8
added fuzzer test for compressSequencesAndLiterals()
Cyan4973 7b294ca
add one valid test case
Cyan4973 72ce56b
fixed another invalid scenario
Cyan4973 788926f
Merge pull request #4217 from facebook/ZSTD_compressSequencesAndLiterals
Cyan4973 f8a2b35
clarify doc on Frame-level methods when invoked on a skippable frame
Cyan4973 a2ff6ea
improve ZSTD_getFrameHeader on skippable frames
Cyan4973 cf5e53f
Merge pull request #4227 from facebook/doc_skippableFrame
Cyan4973 04a2a02
update type names
Cyan4973 f5d9d57
Merge pull request #4228 from facebook/skippableMagicVariant
Cyan4973 54c3d99
Support for libc variants without fseeko/ftello
Victor-C-Zhang 757e29e
Oops
Victor-C-Zhang 6b046f5
PR feedback
Victor-C-Zhang dfb236b
chore: indentation alignment
Victor-C-Zhang 2759d9d
Merge pull request #4229 from facebook/noFseek
Victor-C-Zhang 1548bfc
[opt] Fix too short of match getting generated
terrelln d88651e
Do not vary row matchfinder selection based on availability of SSE2/Neon
Victor-C-Zhang 0fd5210
Update MANDIR for FreeBSD
sunpoet 59c2e33
Merge pull request #4230 from facebook/variedOutput
Victor-C-Zhang f5e2996
Merge pull request #4231 from sunpoet/dev
Cyan4973 a610550
Merge pull request #4218 from facebook/externC
Victor-C-Zhang 42d704a
should check defined(_M_X64) not defined(_M_X86) when building with M…
MessyHack 5650004
bench: nb threads specified with -v
Cyan4973 f5dbdac
fixed macro name typo
Cyan4973 e490be8
fix out-of-bounds array index access
szsam 80af41e
[contrib/pzstd] Prevent hangs when there are errors
yotann afff3d2
return error if block delimiter is not found
szsam 7d63a1c
add prerelease option
lalakii 421f9c9
Merge pull request #4237 from facebook/typo_s
Cyan4973 92d1a7d
Merge pull request #4234 from MessyHack/dev
Cyan4973 908a958
fix clang-pgo test
Cyan4973 0e819c9
fix meson-linux build test
Cyan4973 196e76e
fix make-external-compressors "only-lzma" test
Cyan4973 80ff61d
fixed cmake-build-and-test-check
Cyan4973 642157c
short-test-1: separate tests, giving each a name
Cyan4973 d4ae5c3
update installed lib64gcc version
Cyan4973 43626f1
zlib-wrapper: separate test components to better understand what is f…
Cyan4973 0b96e6d
fixed zlib test
Cyan4973 7227707
Merge pull request #4243 from facebook/fix_ci
Cyan4973 8867204
initial implementation (incomplete)
Cyan4973 d1f0e5f
fullbench can run a verification function
Cyan4973 8d62164
control long length within AVX2 implementation
Cyan4973 bfc58f5
generalize validation function
Cyan4973 8eb2587
added benchmark for get1BlockSummary()
Cyan4973 b6a4d5a
minor +10% speed improvement for scalar ZSTD_get1BlockSummary()
Cyan4973 ed0a8b8
AVX2 version of ZSTD_get1BlockSummary()
Cyan4973 cd53924
removed erroneous #includes
Cyan4973 db3d488
no need for specialized variant
Cyan4973 4aaf9ce
fix minor conversion warning
Cyan4973 57a4554
removed unused variable
Cyan4973 aa2cdf9
added compilation-time checks to ensure AVX2 code is valid
Cyan4973 e3181cf
minor code doc update
Cyan4973 6f8e6f3
create new compilation macro ZSTD_ARCH_X86_AVX2
Cyan4973 debe3d2
removed unused branch
Cyan4973 2f3ee8b
changed code compilation test to employ ZSTD_ARCH_X86_AVX2
Cyan4973 8bff69a
Alignment instruction ZSTD_ALIGNED() in common/compiler.h
Cyan4973 87f0a4f
restore full equation
Cyan4973 33747e2
Merge pull request #4232 from facebook/convertSequences_SSE
Cyan4973 19025f3
Merge pull request #4238 from szsam/patch-1
Cyan4973 319dc29
Merge pull request #4235 from facebook/bench_nbThreads
Cyan4973 c8243b4
Merge pull request #4242 from lalakii/dev
Cyan4973 7827514
Added a final success message at end of tests
Cyan4973 46e17b8
[asm] Enable x86_64 asm for windows builds
pps83 ee17f4c
Use _bzhi_u32 for 32-bit builds when building with STATIC_BMI2
pps83 4f3311f
CI: replaced shortest target by check
Cyan4973 053e4be
Merge pull request #4247 from facebook/test_endMsg
Cyan4973 e8de808
minor: assert that state is not null
Cyan4973 936927a
handle 32bit size_t when building for x64
pps83 26e5fb3
handle 32bit size_t when building for x64
pps83 462484d
change to BitContainerType
pps83 d60c4d7
remove unrelated changes
pps83 fcd684b
update sizeof check
pps83 eb2ceb4
Merge pull request #4249 from facebook/zds_nonnull
Cyan4973 167b004
Merge pull request #4246 from pps83/dev-asmx64-win
Cyan4973 a469e7c
Merge pull request #4248 from pps83/dev-bzhi32
Cyan4973 9efb097
added a CI test for x86 32-bit + avx2 combination
Cyan4973 35edbc2
added avx2 (x64) compilation test
Cyan4973 f0b5f65
fixed minor static function declaration issue
Cyan4973 0501095
added -DSTATIC_BMI2=1 for the -mavx2 test
Cyan4973 27d7940
minor: cosmetic, indentation
Cyan4973 d2d7461
also add `-mbmi2` to the compilation test
Cyan4973 e475dc4
Merge pull request #4250 from facebook/x86_32_avx2
Cyan4973 a556559
no longer limit automated BMI2 detection to x64
Cyan4973 9fbed33
Merge pull request #4251 from facebook/x32_bmi2
Cyan4973 4bbf4a2
enable DYNAMIC_BMI2 by default on x86 (32-bit mode)
Cyan4973 82346b9
minor: generalize BitContainerType
Cyan4973 0c335c9
Merge pull request #4252 from facebook/x32_dynamicBmi2
Cyan4973 48b186f
Merge pull request #4253 from facebook/BitContainerType
Cyan4973 e39ed41
Bump cygwin/cygwin-install-action from 4 to 5
dependabot[bot] 5b9c5d4
Bump github/codeql-action from 3.27.1 to 3.28.1
dependabot[bot] 056492e
Update dev-short-tests.yml
Cyan4973 cf01bbf
Merge pull request #4254 from facebook/dependabot/github_actions/cygw…
Cyan4973 f7c7553
Merge pull request #4255 from facebook/dependabot/github_actions/gith…
Cyan4973 6c1d1cc
Use _M_X64 only without mixing with _M_AMD64
pps83 a0872a8
Implement ZSTD_ALIGNED for ms compiler
pps83 897cec3
Build: Add support for Apple frameworks
Treata11 03d5ad6
Ignore generated framework artifacts
Treata11 becef67
Build: Revert min version to 3.10
Treata11 45c0e72
Instructions for Apple Framework builds
Treata11 2ef57cf
Merge pull request #4259 from Treata11/dev
Cyan4973 55c0c5b
Merge pull request #4258 from pps83/dev-ZSTD_ALIGNED
Cyan4973 a7b59bc
Merge pull request #4257 from pps83/dev-x64test
Cyan4973 1204626
Check `DYNAMIC_BMI2` instead of `DYNAMIC_BMI2 != 0`
pps83 ea0aa03
Merge pull request #4263 from pps83/dev-dyn-bmi2
Cyan4973 59afb28
Remove unused ZSTD_decompressSequences_t typedef
pps83 1b15e88
Move STATIC_BMI2 block as-is to portability_macros.h
pps83 d486ccc
Update comment for STATIC_BMI2 macro
pps83 0a18362
Reorder __BMI2__ check
pps83 f7e8fc3
Check `STATIC_BMI2` instead of `STATIC_BMI2 == 1`
pps83 0cda010
fix formatting
pps83 ab54285
Merge pull request #4266 from pps83/rm-ZSTD_decompressSequences_t
Cyan4973 6cd4204
CI: build with CMake on source directory with spaces to reproduce #4268
luau-project 92be4be
[linux] Expose ZSTD_compressSequencesAndLiterals() in the kernel
gcabiddu 1d088ba
Merge pull request #4260 from gcabiddu/compress_sequences_kernel
Cyan4973 be1bf24
fix: quote include directory for resource compiler
luau-project 6a65a43
Merge pull request #4269 from luau-project/fix-rc-include
Cyan4973 de7c8b9
cmake: Remove duplicated line
tsdgeos 8df6155
CI: enable Intel LLVM C compiler (icx) check
luau-project 283fbd2
Merge pull request #4264 from pps83/dev-static-bmi2
Cyan4973 60f84f7
bench: better result alignment
Cyan4973 b55ff3c
Merge pull request #4278 from facebook/bench_x100
Cyan4973 086ddcd
Merge pull request #4271 from tsdgeos/removedupe
Cyan4973 26a2b5d
Merge pull request #4265 from pps83/static-bmi2-check
Cyan4973 7b856e3
Add noexecstack flag for gcc/clang C and CPP in Meson
Victor-C-Zhang 6e1d02f
adding a Visual + ClangCL + AVX2 compilation test
Cyan4973 bcf404c
changed C11 keyword to _Alignas
Cyan4973 54e9d46
added __clang__ to compiler-specific alignment attribute
Cyan4973 8156a19
Merge pull request #4286 from facebook/visual_clang_avx2
Cyan4973 5883ee6
make visual studio tests error out on warnings
Cyan4973 32dff04
fix one minor alignment warning
Cyan4973 c39424e
fix minor alignment warning
Cyan4973 e117d79
fix minor alignment warning
Cyan4973 f9c1850
fix minor printf argument limitation on older mingw
Cyan4973 590c224
fix more %zu warnings
Cyan4973 e87d159
more %zu warnings fixes
Cyan4973 2949252
fix minor conversion warnings
Cyan4973 30e0f29
Merge pull request #4287 from facebook/warn_error
Cyan4973 ffa66a6
fix speed of --patch-from at high compression mode
Cyan4973 34ba144
minor boundary change
Cyan4973 e637fc6
update type naming convention
Cyan4973 85a44b2
always free .cdictLocal
Cyan4973 220abe6
reduced memory usage
Cyan4973 7406d2b
skips the need to create a temporary cdict for --patch-from
Cyan4973 f11bd19
ensure cdict is properly reset to NULL
Cyan4973 c7cd7dc
better MT fluidity
Cyan4973 23e5f80
Revert "pass dictionary loading method as parameter"
Cyan4973 ef2bf57
Merge pull request #4276 from facebook/fix_patchfrom_hc_speed
Cyan4973 0396480
Merge pull request #4284 from facebook/mesonNoexec
Cyan4973 aebffd6
--ultra automatically triggered with --long and --patch-from
Cyan4973 630b47a
added a new --max command
Cyan4973 8ae1330
add man entry for --max
Cyan4973 41b7193
added --max to test suite
Cyan4973 39d1d82
adjusted mml heuristic
Cyan4973 f86024c
reinforce man page warning
Cyan4973 7a2fce5
Bump github/codeql-action from 3.28.1 to 3.28.9
dependabot[bot] 1603cbe
update test for 32-bit mode
Cyan4973 468e145
disable --max in 32-bit mode
Cyan4973 613901b
modifies command echoing for macos / linux compatibility
Cyan4973 071a4a0
Merge pull request #4291 from facebook/dependabot/github_actions/gith…
Cyan4973 e3a9351
Merge pull request #4290 from facebook/lmax
Cyan4973 5b8575a
Merge pull request #4289 from facebook/autoultra
Cyan4973 4609a40
dynamically adjust hratelog and ldmml based on strategy
Cyan4973 f26cc54
dynamic bucket sizes
Cyan4973 bf218c1
updated LDM documentation
Cyan4973 7c5b600
update results from the --long mode
Cyan4973 72406b7
update hrlog rule to favor compression ratio a bit more at low levels
Cyan4973 d5e4698
fix boundary condition
Cyan4973 09d7e34
adjust mml
Cyan4973 339bca6
update ldm compression results
Cyan4973 67fad95
derive hashratelog from hashlog when only hashlog is set
Cyan4973 d2c562b
update hrlog comment
Cyan4973 d84d70b
Merge pull request #4288 from facebook/stronger_patchfrom
Cyan4973 815ca8c
ubuntu 20 is being deprecated
Cyan4973 fc1baf3
move qemu tests to ubuntu24
Cyan4973 75bcae1
removing x32 tests
Cyan4973 2b7c661
update arm64 test
Cyan4973 b73e06b
updated FreeBSD VM to 14.2
Cyan4973 0b8119f
minor arm64 test script clarification
Cyan4973 85c39b7
faster aarch64 test execution
Cyan4973 2a58b04
disabled BTI test
Cyan4973 beccbc6
Merge pull request #4293 from facebook/rip-ubuntu20
Cyan4973 22c39b9
Merge pull request #4274 from luau-project/intel-compilers
Cyan4973 c26bde1
update changelog for v1.5.7
Cyan4973 99a12e6
Merge pull request #4297 from facebook/changelog157
Cyan4973 5c465fc
harden github actions script Android NDK Build
Cyan4973 b14d76d
pinned dependency hash
Cyan4973 ea027ab
Merge pull request #4299 from facebook/ga_harden
Cyan4973 File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file was deleted.
Oops, something went wrong.
This file was deleted.
Oops, something went wrong.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -1,10 +1,9 @@ | ||
| task: | ||
| name: FreeBSD (shortest) | ||
| name: FreeBSD (make check) | ||
| freebsd_instance: | ||
| matrix: | ||
| image_family: freebsd-14-0 | ||
| image_family: freebsd-13-2 | ||
| image_family: freebsd-14-2 | ||
| install_script: pkg install -y gmake coreutils | ||
| script: | | ||
| MOREFLAGS="-Werror" gmake -j all | ||
| gmake shortest | ||
| gmake check |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,39 @@ | ||
| name: Android NDK Build | ||
|
|
||
| on: | ||
| pull_request: | ||
| branches: [ dev, release, actionsTest ] | ||
| push: | ||
| branches: [ actionsTest, '*ndk*' ] | ||
|
|
||
| permissions: read-all | ||
|
|
||
| jobs: | ||
| build: | ||
| runs-on: ubuntu-latest | ||
|
|
||
| steps: | ||
| - uses: actions/checkout@b4ffde65f46336ab88eb53be808477a3936bae11 # tag=v4.1.1 | ||
|
|
||
| - name: Set up JDK 17 | ||
| uses: actions/setup-java@3a4f6e1af504cf6a31855fa899c6aa5355ba6c12 # v4.7.0 | ||
| with: | ||
| java-version: '17' | ||
| distribution: 'temurin' | ||
|
|
||
| - name: Setup Android SDK | ||
| uses: android-actions/setup-android@9fc6c4e9069bf8d3d10b2204b1fb8f6ef7065407 # v3.2.2 | ||
|
|
||
| - name: Install Android NDK | ||
| run: | | ||
| sdkmanager --install "ndk;27.0.12077973" | ||
| echo "ANDROID_NDK_HOME=$ANDROID_SDK_ROOT/ndk/27.0.12077973" >> $GITHUB_ENV | ||
|
|
||
| - name: Build with NDK | ||
| run: | | ||
| export PATH=$ANDROID_NDK_HOME/toolchains/llvm/prebuilt/linux-x86_64/bin:$PATH | ||
| make CC=aarch64-linux-android21-clang \ | ||
| AR=llvm-ar \ | ||
| RANLIB=llvm-ranlib \ | ||
| STRIP=llvm-strip | ||
|
|
||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.