Open
Description
Differential E2E tests help us ensure ETH compatibility as well as reproducible builds across supported platforms.
A comprehensive testing framework is currently being developed. We need a CI workflow which uses the harness and executes implemented cases (after all other workflows succeeded) as follows:
The following resolc binaries should be tested per platform.
- Linux MUSL
- MacOS universal
- Windows
- Wasm32 emscripten
The following networks must be used for test output differentiation (return data, emitted events, state diffs regarding storage):
- Westend
- Ethereum
The following settings must be tested:
-O3-Oz-g
Any final compilation artifacts (i.e. PVM blobs) equal each others exactly for each platforms and compiler setting combinations, which the workflow must verify.