[fuzzing] execute every exported function #3959

lum1n0us · 2024-12-15T12:27:12Z

…nd random value generation

…ion and ensure termination in WASM shape

…nt logging in execution

yamt · 2025-01-06T04:21:03Z

for a similar fuzzier (https://github.com/yamt/toywasm/tree/master/examples/fuzz)
i ended up with having a small limit for the number of functions to execute
because a module can have a ton of exported functions.
i'm not sure if the same concern applies to this fuzzier. just FYI.

lum1n0us · 2025-01-06T06:13:51Z

i ended up with having a small limit for the number of functions to execute because a module can have a ton of exported functions.

May I ask the negative consequences of executing too many functions?

yamt · 2025-01-06T06:38:46Z

i ended up with having a small limit for the number of functions to execute because a module can have a ton of exported functions.

May I ask the negative consequences of executing too many functions?

it takes very long. practically ~forever.

lum1n0us · 2025-01-07T13:19:20Z

Just FYI:

If the issue is due to an infinite loop, the --fuel option can be utilized to prevent the endless execution scenario.

yamt · 2025-01-07T13:24:33Z

Just FYI:

If the issue is due to an infinite loop, the --fuel option can be utilized to prevent the endless execution scenario.

does the fuel thing "accumulate" among function calls?
otherwise it isn't a solution.

lum1n0us · 2025-01-07T13:30:17Z

-f, --fuel This is roughly the number of loop iterations and function calls that will be executed before a trap is raised to prevent infinite loops.

IIUC, yes.

tests/fuzz/wasm-mutator-fuzz/wasm_mutator_fuzz.cc

TianlongLiang

LGTM

- fix: when load aot init expr,no type_idx set. (bytecodealliance#4094) - Cmake improvements (bytecodealliance#4076) - fix(aot_emit_aot_file): prevent buffer emission for zero byte_count (bytecodealliance#4095) - fix(unit-test): libc_builtin_test issues (bytecodealliance#4073) - feat: add support for EXTERNREF value type and enable AOT validator in fuzz tests (bytecodealliance#4083) - [gc] Subtyping fix (bytecodealliance#4075) - Add a conditional check for the macro __STDC_VERSION__ (bytecodealliance#4080) - Unit test:type matching issue and code redundancy (bytecodealliance#4079) - build(deps): Bump github/codeql-action from 3.28.8 to 3.28.9 (bytecodealliance#4074) - fix(aot): ensure value_cmp does not exceed br_count in branch table compilation (bytecodealliance#4065) - In wasm32, fix potential conversion overflow when enlarging 65536 pages (bytecodealliance#4064) - [fuzzing] execute every exported function (bytecodealliance#3959) - Update memory allocation functions to use allocator user data (bytecodealliance#4043) - Show wasm proposals status during compilation and execution (bytecodealliance#3989) - add a validator for aot module (bytecodealliance#3995) - Use wasm32-wasip1 instead of wasm32-wasi target for rust code (bytecodealliance#4057) - Update Rust target from 'wasm32-wasi' to 'wasm32-wasip1' in CI (bytecodealliance#4050) - Fix wasm loader check data segment count (bytecodealliance#4039) - Synchronize the GC spec tests to the commit from December 9. 2024. (bytecodealliance#4022) - Refine getting const offsets in wasm loader of fast-interp (bytecodealliance#4012) - fixes for compiling on windows (bytecodealliance#4026) - .github: Add shared lib builds (bytecodealliance#3975) - Refine read leb int wasm loader of fast interpreter (bytecodealliance#4017) - build(deps): Bump github/codeql-action from 3.28.0 to 3.28.1 (bytecodealliance#4020) - build(deps): Bump actions/upload-artifact from 4.5.0 to 4.6.0 (bytecodealliance#4021) - Enable shrunk memory by default and add related configurations (bytecodealliance#4008) - Add documentation regarding security issues and the status of Wasm proposals (bytecodealliance#3972) - Improve stack consistency by ensuring sufficient space for dummy offsets (bytecodealliance#4011) - Check whether related table has funcref elem in opcode call_indirect (bytecodealliance#3999) - [fuzzing] Use software bound-check during fuzzing (bytecodealliance#4003) - Add an example of how to embed WAMR in Zephyr user mode (bytecodealliance#3998) - Fix table index calculations in wasm_loader and wasm_mini_loader (bytecodealliance#4004) - Ensure __heap_base and __data_end global indices are validated against import count (bytecodealliance#3996) - Error message improvement (bytecodealliance#4000) - Handle a new scenario where an item is both exported and imported. (bytecodealliance#3984) - Optimize memory initialization handling in AOT loader (bytecodealliance#3983) - build(deps): Bump actions/upload-artifact from 4.4.3 to 4.5.0 (bytecodealliance#3981) - build(deps): Bump github/codeql-action from 3.27.9 to 3.28.0 (bytecodealliance#3982) - Add Tianlong into code owners (bytecodealliance#3970) - Set thread information earlier in exec_env creation (bytecodealliance#3967) - top-level cmake: link llvm libraries to our shared library (bytecodealliance#3973) - add reference type support by default for darwin to support WASI-SDK-25 (bytecodealliance#3978) - CMakeLists.txt: Do not require C++ (bytecodealliance#3956) - [fuzzing] Enable instantiation (bytecodealliance#3958) - use a random secret key (bytecodealliance#3971) - top-level cmakefile: fix macOS build (bytecodealliance#3968) - Only access Zephyr thread stats info when it's available (bytecodealliance#3962) - build(deps): Bump github/codeql-action from 3.27.6 to 3.27.9 (bytecodealliance#3960) - wasm_export.h: Use "default" visibility for gcc and clang (bytecodealliance#3957) - set alignment 4 when loading multi return value (bytecodealliance#3955) - Fix aot table instantiate (bytecodealliance#3946) - Consume the placeholders that were put when emitting table info (bytecodealliance#3940) - Refactor SConscript and add file checks in iwasm.c (bytecodealliance#3945) - Improvements for platform thread APIs on Windows and Zephyr (bytecodealliance#3941) - Fix incorrect assignment in win_file.c (bytecodealliance#3939) - don't return an uninitialized trap if argv_to_results fails (bytecodealliance#3935) - support WASM_FUNCREF return type in argv_to_results (bytecodealliance#3936) - add thread cpu time for zephyr (bytecodealliance#3937) - build(deps): bump github/codeql-action from 3.27.4 to 3.27.5 (bytecodealliance#3931) - Update README.md to clarify Windows toolchain support and ESP-IDF reference (bytecodealliance#3917) - Enable ref types by default (bytecodealliance#3894) - Fix loader small bug (bytecodealliance#3928) - add testcases for shared heap and fix POP_MEM_OFFSET of memory64 (bytecodealliance#3916) - Use plain assignment rather than bh_memcpy_s (bytecodealliance#3924) - Fix WASI Path Mapping Processing (bytecodealliance#3923) - Drop declarative elements on module instantiation (bytecodealliance#3922) - Check possible integer overflow in aot memory boundary check (bytecodealliance#3920) - Fix CI wamr-ide error (bytecodealliance#3913) - Support external toolchain on Windows for aot compiler (bytecodealliance#3911) - build(deps): bump github/codeql-action from 3.27.1 to 3.27.4 (bytecodealliance#3912) - Correct the table index calculation in aot_instantiation (bytecodealliance#3903) - Fix a leak in wasm_loader_emit_br_info (bytecodealliance#3900) - GlobalValueSet was moved to IRPartitionLayer recently, but we have a local definition anyway (bytecodealliance#3899) - build(deps): bump github/codeql-action from 3.27.0 to 3.27.1 (bytecodealliance#3902) - Fix linked global initialization in multimodule (bytecodealliance#3905) - Wasm loader enhancement: check code size in code entry (bytecodealliance#3892) - Refactor AOT loader to support compatible versions (bytecodealliance#3891) - Fix out of bounds issue in is_native_addr_in_shared_heap function (bytecodealliance#3886) - Fix mmap flags for AOT loader on non-Linux SGX platforms (bytecodealliance#3890) - Bump AOT_CURRENT_VERSION for WAMR 2.x (gc, memory64) (bytecodealliance#3880) - Refine looking up aot function with index (bytecodealliance#3882) - build(deps): bump github/codeql-action from 3.26.13 to 3.27.0 (bytecodealliance#3888) - fix(ios): Remove `float-abi` flag (bytecodealliance#3889) - Fix out of bounds issues after memory.grow on non-aot non-threads builds (bytecodealliance#3872) - Exclude fuzz test python and npm packages in scoreboard scan (bytecodealliance#3871) Author: Chris Woods <[email protected]> Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Author: Dylan Johnston <[email protected]> Author: edoardo <[email protected]> Author: eric <[email protected]> Author: Fadumina Barre <[email protected]> Author: Huang Qi <[email protected]> Author: James Ring <[email protected]> Author: Jérôme Vouillon <[email protected]> Author: kk <[email protected]> Author: [email protected] <[email protected]> Author: liang.he <[email protected]> Author: Maks Litskevich <[email protected]> Author: Marcin Kolny <[email protected]> Author: peter-tatrai <[email protected]> Author: TianlongLiang <[email protected]> Author: Tomáš Malý <[email protected]> Author: Viacheslav Palchikov <[email protected]> Author: WenLY1 <[email protected]> Author: Wenyong Huang <[email protected]> Author: Xavier Del Campo <[email protected]> Author: YAMAMOTO Takashi <[email protected]> Author: yangkun27 <[email protected]>

- fix: when load aot init expr,no type_idx set. (#4094) - Cmake improvements (#4076) - fix(aot_emit_aot_file): prevent buffer emission for zero byte_count (#4095) - fix(unit-test): libc_builtin_test issues (#4073) - feat: add support for EXTERNREF value type and enable AOT validator in fuzz tests (#4083) - [gc] Subtyping fix (#4075) - Add a conditional check for the macro __STDC_VERSION__ (#4080) - Unit test:type matching issue and code redundancy (#4079) - build(deps): Bump github/codeql-action from 3.28.8 to 3.28.9 (#4074) - fix(aot): ensure value_cmp does not exceed br_count in branch table compilation (#4065) - In wasm32, fix potential conversion overflow when enlarging 65536 pages (#4064) - [fuzzing] execute every exported function (#3959) - Update memory allocation functions to use allocator user data (#4043) - Show wasm proposals status during compilation and execution (#3989) - add a validator for aot module (#3995) - Use wasm32-wasip1 instead of wasm32-wasi target for rust code (#4057) - Update Rust target from 'wasm32-wasi' to 'wasm32-wasip1' in CI (#4050) - Fix wasm loader check data segment count (#4039) - Synchronize the GC spec tests to the commit from December 9. 2024. (#4022) - Refine getting const offsets in wasm loader of fast-interp (#4012) - fixes for compiling on windows (#4026) - .github: Add shared lib builds (#3975) - Refine read leb int wasm loader of fast interpreter (#4017) - build(deps): Bump github/codeql-action from 3.28.0 to 3.28.1 (#4020) - build(deps): Bump actions/upload-artifact from 4.5.0 to 4.6.0 (#4021) - Enable shrunk memory by default and add related configurations (#4008) - Add documentation regarding security issues and the status of Wasm proposals (#3972) - Improve stack consistency by ensuring sufficient space for dummy offsets (#4011) - Check whether related table has funcref elem in opcode call_indirect (#3999) - [fuzzing] Use software bound-check during fuzzing (#4003) - Add an example of how to embed WAMR in Zephyr user mode (#3998) - Fix table index calculations in wasm_loader and wasm_mini_loader (#4004) - Ensure __heap_base and __data_end global indices are validated against import count (#3996) - Error message improvement (#4000) - Handle a new scenario where an item is both exported and imported. (#3984) - Optimize memory initialization handling in AOT loader (#3983) - build(deps): Bump actions/upload-artifact from 4.4.3 to 4.5.0 (#3981) - build(deps): Bump github/codeql-action from 3.27.9 to 3.28.0 (#3982) - Add Tianlong into code owners (#3970) - Set thread information earlier in exec_env creation (#3967) - top-level cmake: link llvm libraries to our shared library (#3973) - add reference type support by default for darwin to support WASI-SDK-25 (#3978) - CMakeLists.txt: Do not require C++ (#3956) - [fuzzing] Enable instantiation (#3958) - use a random secret key (#3971) - top-level cmakefile: fix macOS build (#3968) - Only access Zephyr thread stats info when it's available (#3962) - build(deps): Bump github/codeql-action from 3.27.6 to 3.27.9 (#3960) - wasm_export.h: Use "default" visibility for gcc and clang (#3957) - set alignment 4 when loading multi return value (#3955) - Fix aot table instantiate (#3946) - Consume the placeholders that were put when emitting table info (#3940) - Refactor SConscript and add file checks in iwasm.c (#3945) - Improvements for platform thread APIs on Windows and Zephyr (#3941) - Fix incorrect assignment in win_file.c (#3939) - don't return an uninitialized trap if argv_to_results fails (#3935) - support WASM_FUNCREF return type in argv_to_results (#3936) - add thread cpu time for zephyr (#3937) - build(deps): bump github/codeql-action from 3.27.4 to 3.27.5 (#3931) - Update README.md to clarify Windows toolchain support and ESP-IDF reference (#3917) - Enable ref types by default (#3894) - Fix loader small bug (#3928) - add testcases for shared heap and fix POP_MEM_OFFSET of memory64 (#3916) - Use plain assignment rather than bh_memcpy_s (#3924) - Fix WASI Path Mapping Processing (#3923) - Drop declarative elements on module instantiation (#3922) - Check possible integer overflow in aot memory boundary check (#3920) - Fix CI wamr-ide error (#3913) - Support external toolchain on Windows for aot compiler (#3911) - build(deps): bump github/codeql-action from 3.27.1 to 3.27.4 (#3912) - Correct the table index calculation in aot_instantiation (#3903) - Fix a leak in wasm_loader_emit_br_info (#3900) - GlobalValueSet was moved to IRPartitionLayer recently, but we have a local definition anyway (#3899) - build(deps): bump github/codeql-action from 3.27.0 to 3.27.1 (#3902) - Fix linked global initialization in multimodule (#3905) - Wasm loader enhancement: check code size in code entry (#3892) - Refactor AOT loader to support compatible versions (#3891) - Fix out of bounds issue in is_native_addr_in_shared_heap function (#3886) - Fix mmap flags for AOT loader on non-Linux SGX platforms (#3890) - Bump AOT_CURRENT_VERSION for WAMR 2.x (gc, memory64) (#3880) - Refine looking up aot function with index (#3882) - build(deps): bump github/codeql-action from 3.26.13 to 3.27.0 (#3888) - fix(ios): Remove `float-abi` flag (#3889) - Fix out of bounds issues after memory.grow on non-aot non-threads builds (#3872) - Exclude fuzz test python and npm packages in scoreboard scan (#3871) Author: Chris Woods <[email protected]> Author: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Author: Dylan Johnston <[email protected]> Author: edoardo <[email protected]> Author: eric <[email protected]> Author: Fadumina Barre <[email protected]> Author: Huang Qi <[email protected]> Author: James Ring <[email protected]> Author: Jérôme Vouillon <[email protected]> Author: kk <[email protected]> Author: [email protected] <[email protected]> Author: liang.he <[email protected]> Author: Maks Litskevich <[email protected]> Author: Marcin Kolny <[email protected]> Author: peter-tatrai <[email protected]> Author: TianlongLiang <[email protected]> Author: Tomáš Malý <[email protected]> Author: Viacheslav Palchikov <[email protected]> Author: WenLY1 <[email protected]> Author: Wenyong Huang <[email protected]> Author: Xavier Del Campo <[email protected]> Author: YAMAMOTO Takashi <[email protected]> Author: yangkun27 <[email protected]>

- Enhance wasm mutator fuzz tests by adding export function execution and random value generation - Use --fuel to limit loop size - Use predefined values and enhance argument logging in execution

lum1n0us force-pushed the fix/fuzzing_execution branch 3 times, most recently from 4042677 to c4e6caa Compare December 24, 2024 08:14

lum1n0us added 6 commits January 4, 2025 08:51

Enhance wasm mutator fuzz tests by adding export function execution a…

4e0bef5

…nd random value generation

Enhance wasm mutator fuzz tests with improved argument logging

5ced3ae

Refactor wasm mutator fuzz tests to use simpler random number generat…

7d51962

…ion and ensure termination in WASM shape

Remove unnecessary inclusion of <bits/stdc++.h>

5f0f852

use --fuel to limit loop size

bb52418

Refactor wasm interpreter to use predefined values and enhance argume…

59b1581

…nt logging in execution

lum1n0us force-pushed the fix/fuzzing_execution branch from c4e6caa to 59b1581 Compare January 5, 2025 08:31

lum1n0us marked this pull request as ready for review January 5, 2025 08:33

lum1n0us requested review from loganek, no1wudi, TianlongLiang, wenyongh, xujuntwt95329 and yamt as code owners January 5, 2025 08:33

xujuntwt95329 reviewed Jan 9, 2025

View reviewed changes

tests/fuzz/wasm-mutator-fuzz/wasm_mutator_fuzz.cc Show resolved Hide resolved

TianlongLiang approved these changes Jan 23, 2025

View reviewed changes

yamt approved these changes Feb 6, 2025

View reviewed changes

lum1n0us merged commit c99ae24 into bytecodealliance:main Feb 6, 2025
383 checks passed

lum1n0us deleted the fix/fuzzing_execution branch February 6, 2025 05:15

lum1n0us mentioned this pull request Feb 23, 2025

Merge branch main into dev/instantiate_linking #4100

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[fuzzing] execute every exported function #3959

[fuzzing] execute every exported function #3959

lum1n0us commented Dec 15, 2024 •

edited

Loading

yamt commented Jan 6, 2025

lum1n0us commented Jan 6, 2025

yamt commented Jan 6, 2025

lum1n0us commented Jan 7, 2025

yamt commented Jan 7, 2025

lum1n0us commented Jan 7, 2025

TianlongLiang left a comment

[fuzzing] execute every exported function #3959

[fuzzing] execute every exported function #3959

Conversation

lum1n0us commented Dec 15, 2024 • edited Loading

yamt commented Jan 6, 2025

lum1n0us commented Jan 6, 2025

yamt commented Jan 6, 2025

lum1n0us commented Jan 7, 2025

yamt commented Jan 7, 2025

lum1n0us commented Jan 7, 2025

TianlongLiang left a comment

Choose a reason for hiding this comment

lum1n0us commented Dec 15, 2024 •

edited

Loading