Skip to content

Adding bignum in to the benchmarks. #40

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 3 commits into
base: main
Choose a base branch
from
Open

Adding bignum in to the benchmarks. #40

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
a827538
Adding big num
Machiry Aug 9, 2021
70b0938
Doing regular make
Machiry Aug 9, 2021
76b1857
Using regular make for tiny big num
Machiry Aug 9, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
166 changes: 166 additions & 0 deletions .github/workflows/exhaustiveccured.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -437,6 +437,172 @@ jobs:
if [ -e "out.checked" ]; then cp -r out.checked/* . && rm -r out.checked; fi
make -j $(nproc) -l $(nproc) --output-sync CC="${{env.builddir}}/bin/clang" -k 2>&1 | ${{github.workspace}}/depsfolder/actions/filter-bounds-inference-errors.py

test_TinyBigNum_no_expand_macros_alltypes_disable_rds:
name: Test TinyBigNum (not macro-expanded, -alltypes, CCured solution)
needs: build_3c
runs-on: self-hosted
steps:
- name: Build TinyBigNum
run: |
mkdir -p ${{env.benchmark_conv_dir}}/no_expand_macros_alltypes_disable_rds
cd ${{env.benchmark_conv_dir}}/no_expand_macros_alltypes_disable_rds
tar -xvzf ${{env.benchmark_tar_dir}}/tiny-bignum-c.tar.gz
cd tiny-bignum-c
bear make -j $(nproc) -l $(nproc) --output-sync CC="${{env.builddir}}/bin/clang"

- name: Convert TinyBigNum
run: |
cd ${{env.benchmark_conv_dir}}/no_expand_macros_alltypes_disable_rds/tiny-bignum-c
${{env.port_tools}}/convert_project.py \
--prog_name ${{env.builddir}}/bin/3c \
--extra-3c-arg=-alltypes \
--extra-3c-arg=-disable-rds \
--project_path .

- name: Copy 3c stats of TinyBigNum
run: |
cd ${{env.benchmark_conv_dir}}/no_expand_macros_alltypes_disable_rds/tiny-bignum-c
mkdir 3c_performance_stats/
cp *.json 3c_performance_stats/

- name: Upload 3c stats of TinyBigNum
uses: actions/upload-artifact@v2
with:
name: TinyBigNum_no_expand_macros_alltypes_disable_rds
path: ${{env.benchmark_conv_dir}}/no_expand_macros_alltypes_disable_rds/tiny-bignum-c/3c_performance_stats/
retention-days: 5

- name: Build converted TinyBigNum (filter bounds inference errors)
run: |
cd ${{env.benchmark_conv_dir}}/no_expand_macros_alltypes_disable_rds/tiny-bignum-c
if [ -e "out.checked" ]; then cp -r out.checked/* . && rm -r out.checked; fi
make -j $(nproc) -l $(nproc) --output-sync CC="${{env.builddir}}/bin/clang" -k 2>&1 | ${{github.workspace}}/depsfolder/actions/filter-bounds-inference-errors.py

test_TinyBigNum_no_expand_macros_alltypes_disable_fnedgs:
name: Test TinyBigNum (not macro-expanded, -alltypes, FuncRevEdges solution)
needs: build_3c
runs-on: self-hosted
steps:
- name: Build TinyBigNum
run: |
mkdir -p ${{env.benchmark_conv_dir}}/no_expand_macros_alltypes_disable_fnedgs
cd ${{env.benchmark_conv_dir}}/no_expand_macros_alltypes_disable_fnedgs
tar -xvzf ${{env.benchmark_tar_dir}}/tiny-bignum-c.tar.gz
cd tiny-bignum-c
bear make -j $(nproc) -l $(nproc) --output-sync CC="${{env.builddir}}/bin/clang"

- name: Convert TinyBigNum
run: |
cd ${{env.benchmark_conv_dir}}/no_expand_macros_alltypes_disable_fnedgs/tiny-bignum-c
${{env.port_tools}}/convert_project.py \
--prog_name ${{env.builddir}}/bin/3c \
--extra-3c-arg=-alltypes \
--extra-3c-arg=-disable-fnedgs \
--project_path .

- name: Copy 3c stats of TinyBigNum
run: |
cd ${{env.benchmark_conv_dir}}/no_expand_macros_alltypes_disable_fnedgs/tiny-bignum-c
mkdir 3c_performance_stats/
cp *.json 3c_performance_stats/

- name: Upload 3c stats of TinyBigNum
uses: actions/upload-artifact@v2
with:
name: TinyBigNum_no_expand_macros_alltypes_disable_fnedgs
path: ${{env.benchmark_conv_dir}}/no_expand_macros_alltypes_disable_fnedgs/tiny-bignum-c/3c_performance_stats/
retention-days: 5

- name: Build converted TinyBigNum (filter bounds inference errors)
run: |
cd ${{env.benchmark_conv_dir}}/no_expand_macros_alltypes_disable_fnedgs/tiny-bignum-c
if [ -e "out.checked" ]; then cp -r out.checked/* . && rm -r out.checked; fi
make -j $(nproc) -l $(nproc) --output-sync CC="${{env.builddir}}/bin/clang" -k 2>&1 | ${{github.workspace}}/depsfolder/actions/filter-bounds-inference-errors.py

test_TinyBigNum_expand_macros_alltypes_disable_rds:
name: Test TinyBigNum (macro-expanded, -alltypes, CCured solution)
needs: build_3c
runs-on: self-hosted
steps:
- name: Build TinyBigNum
run: |
mkdir -p ${{env.benchmark_conv_dir}}/expand_macros_alltypes_disable_rds
cd ${{env.benchmark_conv_dir}}/expand_macros_alltypes_disable_rds
tar -xvzf ${{env.benchmark_tar_dir}}/tiny-bignum-c.tar.gz
cd tiny-bignum-c
bear make -j $(nproc) -l $(nproc) --output-sync CC="${{env.builddir}}/bin/clang"

- name: Convert TinyBigNum
run: |
cd ${{env.benchmark_conv_dir}}/expand_macros_alltypes_disable_rds/tiny-bignum-c
${{env.port_tools}}/convert_project.py \
--prog_name ${{env.builddir}}/bin/3c \
--extra-3c-arg=-alltypes \
--expand_macros_before_conversion \
--extra-3c-arg=-disable-rds \
--project_path .

- name: Copy 3c stats of TinyBigNum
run: |
cd ${{env.benchmark_conv_dir}}/expand_macros_alltypes_disable_rds/tiny-bignum-c
mkdir 3c_performance_stats/
cp *.json 3c_performance_stats/

- name: Upload 3c stats of TinyBigNum
uses: actions/upload-artifact@v2
with:
name: TinyBigNum_expand_macros_alltypes_disable_rds
path: ${{env.benchmark_conv_dir}}/expand_macros_alltypes_disable_rds/tiny-bignum-c/3c_performance_stats/
retention-days: 5

- name: Build converted TinyBigNum (filter bounds inference errors)
run: |
cd ${{env.benchmark_conv_dir}}/expand_macros_alltypes_disable_rds/tiny-bignum-c
if [ -e "out.checked" ]; then cp -r out.checked/* . && rm -r out.checked; fi
make -j $(nproc) -l $(nproc) --output-sync CC="${{env.builddir}}/bin/clang" -k 2>&1 | ${{github.workspace}}/depsfolder/actions/filter-bounds-inference-errors.py

test_TinyBigNum_expand_macros_alltypes_disable_fnedgs:
name: Test TinyBigNum (macro-expanded, -alltypes, FuncRevEdges solution)
needs: build_3c
runs-on: self-hosted
steps:
- name: Build TinyBigNum
run: |
mkdir -p ${{env.benchmark_conv_dir}}/expand_macros_alltypes_disable_fnedgs
cd ${{env.benchmark_conv_dir}}/expand_macros_alltypes_disable_fnedgs
tar -xvzf ${{env.benchmark_tar_dir}}/tiny-bignum-c.tar.gz
cd tiny-bignum-c
bear make -j $(nproc) -l $(nproc) --output-sync CC="${{env.builddir}}/bin/clang"

- name: Convert TinyBigNum
run: |
cd ${{env.benchmark_conv_dir}}/expand_macros_alltypes_disable_fnedgs/tiny-bignum-c
${{env.port_tools}}/convert_project.py \
--prog_name ${{env.builddir}}/bin/3c \
--extra-3c-arg=-alltypes \
--expand_macros_before_conversion \
--extra-3c-arg=-disable-fnedgs \
--project_path .

- name: Copy 3c stats of TinyBigNum
run: |
cd ${{env.benchmark_conv_dir}}/expand_macros_alltypes_disable_fnedgs/tiny-bignum-c
mkdir 3c_performance_stats/
cp *.json 3c_performance_stats/

- name: Upload 3c stats of TinyBigNum
uses: actions/upload-artifact@v2
with:
name: TinyBigNum_expand_macros_alltypes_disable_fnedgs
path: ${{env.benchmark_conv_dir}}/expand_macros_alltypes_disable_fnedgs/tiny-bignum-c/3c_performance_stats/
retention-days: 5

- name: Build converted TinyBigNum (filter bounds inference errors)
run: |
cd ${{env.benchmark_conv_dir}}/expand_macros_alltypes_disable_fnedgs/tiny-bignum-c
if [ -e "out.checked" ]; then cp -r out.checked/* . && rm -r out.checked; fi
make -j $(nproc) -l $(nproc) --output-sync CC="${{env.builddir}}/bin/clang" -k 2>&1 | ${{github.workspace}}/depsfolder/actions/filter-bounds-inference-errors.py

test_Olden_no_expand_macros_alltypes_disable_rds:
name: Test Olden (not macro-expanded, -alltypes, CCured solution)
needs: build_3c
Expand Down
166 changes: 166 additions & 0 deletions .github/workflows/exhaustiveleastgreatest.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -437,6 +437,172 @@ jobs:
if [ -e "out.checked" ]; then cp -r out.checked/* . && rm -r out.checked; fi
make -j $(nproc) -l $(nproc) --output-sync CC="${{env.builddir}}/bin/clang" -k 2>&1 | ${{github.workspace}}/depsfolder/actions/filter-bounds-inference-errors.py

test_TinyBigNum_no_expand_macros_alltypes_only_g_sol:
name: Test TinyBigNum (not macro-expanded, -alltypes, greatest solution)
needs: build_3c
runs-on: self-hosted
steps:
- name: Build TinyBigNum
run: |
mkdir -p ${{env.benchmark_conv_dir}}/no_expand_macros_alltypes_only_g_sol
cd ${{env.benchmark_conv_dir}}/no_expand_macros_alltypes_only_g_sol
tar -xvzf ${{env.benchmark_tar_dir}}/tiny-bignum-c.tar.gz
cd tiny-bignum-c
bear make -j $(nproc) -l $(nproc) --output-sync CC="${{env.builddir}}/bin/clang"

- name: Convert TinyBigNum
run: |
cd ${{env.benchmark_conv_dir}}/no_expand_macros_alltypes_only_g_sol/tiny-bignum-c
${{env.port_tools}}/convert_project.py \
--prog_name ${{env.builddir}}/bin/3c \
--extra-3c-arg=-alltypes \
--extra-3c-arg=-only-g-sol \
--project_path .

- name: Copy 3c stats of TinyBigNum
run: |
cd ${{env.benchmark_conv_dir}}/no_expand_macros_alltypes_only_g_sol/tiny-bignum-c
mkdir 3c_performance_stats/
cp *.json 3c_performance_stats/

- name: Upload 3c stats of TinyBigNum
uses: actions/upload-artifact@v2
with:
name: TinyBigNum_no_expand_macros_alltypes_only_g_sol
path: ${{env.benchmark_conv_dir}}/no_expand_macros_alltypes_only_g_sol/tiny-bignum-c/3c_performance_stats/
retention-days: 5

- name: Build converted TinyBigNum (filter bounds inference errors)
run: |
cd ${{env.benchmark_conv_dir}}/no_expand_macros_alltypes_only_g_sol/tiny-bignum-c
if [ -e "out.checked" ]; then cp -r out.checked/* . && rm -r out.checked; fi
make -j $(nproc) -l $(nproc) --output-sync CC="${{env.builddir}}/bin/clang" -k 2>&1 | ${{github.workspace}}/depsfolder/actions/filter-bounds-inference-errors.py

test_TinyBigNum_no_expand_macros_alltypes_only_l_sol:
name: Test TinyBigNum (not macro-expanded, -alltypes, least solution)
needs: build_3c
runs-on: self-hosted
steps:
- name: Build TinyBigNum
run: |
mkdir -p ${{env.benchmark_conv_dir}}/no_expand_macros_alltypes_only_l_sol
cd ${{env.benchmark_conv_dir}}/no_expand_macros_alltypes_only_l_sol
tar -xvzf ${{env.benchmark_tar_dir}}/tiny-bignum-c.tar.gz
cd tiny-bignum-c
bear make -j $(nproc) -l $(nproc) --output-sync CC="${{env.builddir}}/bin/clang"

- name: Convert TinyBigNum
run: |
cd ${{env.benchmark_conv_dir}}/no_expand_macros_alltypes_only_l_sol/tiny-bignum-c
${{env.port_tools}}/convert_project.py \
--prog_name ${{env.builddir}}/bin/3c \
--extra-3c-arg=-alltypes \
--extra-3c-arg=-only-l-sol \
--project_path .

- name: Copy 3c stats of TinyBigNum
run: |
cd ${{env.benchmark_conv_dir}}/no_expand_macros_alltypes_only_l_sol/tiny-bignum-c
mkdir 3c_performance_stats/
cp *.json 3c_performance_stats/

- name: Upload 3c stats of TinyBigNum
uses: actions/upload-artifact@v2
with:
name: TinyBigNum_no_expand_macros_alltypes_only_l_sol
path: ${{env.benchmark_conv_dir}}/no_expand_macros_alltypes_only_l_sol/tiny-bignum-c/3c_performance_stats/
retention-days: 5

- name: Build converted TinyBigNum (filter bounds inference errors)
run: |
cd ${{env.benchmark_conv_dir}}/no_expand_macros_alltypes_only_l_sol/tiny-bignum-c
if [ -e "out.checked" ]; then cp -r out.checked/* . && rm -r out.checked; fi
make -j $(nproc) -l $(nproc) --output-sync CC="${{env.builddir}}/bin/clang" -k 2>&1 | ${{github.workspace}}/depsfolder/actions/filter-bounds-inference-errors.py

test_TinyBigNum_expand_macros_alltypes_only_g_sol:
name: Test TinyBigNum (macro-expanded, -alltypes, greatest solution)
needs: build_3c
runs-on: self-hosted
steps:
- name: Build TinyBigNum
run: |
mkdir -p ${{env.benchmark_conv_dir}}/expand_macros_alltypes_only_g_sol
cd ${{env.benchmark_conv_dir}}/expand_macros_alltypes_only_g_sol
tar -xvzf ${{env.benchmark_tar_dir}}/tiny-bignum-c.tar.gz
cd tiny-bignum-c
bear make -j $(nproc) -l $(nproc) --output-sync CC="${{env.builddir}}/bin/clang"

- name: Convert TinyBigNum
run: |
cd ${{env.benchmark_conv_dir}}/expand_macros_alltypes_only_g_sol/tiny-bignum-c
${{env.port_tools}}/convert_project.py \
--prog_name ${{env.builddir}}/bin/3c \
--extra-3c-arg=-alltypes \
--expand_macros_before_conversion \
--extra-3c-arg=-only-g-sol \
--project_path .

- name: Copy 3c stats of TinyBigNum
run: |
cd ${{env.benchmark_conv_dir}}/expand_macros_alltypes_only_g_sol/tiny-bignum-c
mkdir 3c_performance_stats/
cp *.json 3c_performance_stats/

- name: Upload 3c stats of TinyBigNum
uses: actions/upload-artifact@v2
with:
name: TinyBigNum_expand_macros_alltypes_only_g_sol
path: ${{env.benchmark_conv_dir}}/expand_macros_alltypes_only_g_sol/tiny-bignum-c/3c_performance_stats/
retention-days: 5

- name: Build converted TinyBigNum (filter bounds inference errors)
run: |
cd ${{env.benchmark_conv_dir}}/expand_macros_alltypes_only_g_sol/tiny-bignum-c
if [ -e "out.checked" ]; then cp -r out.checked/* . && rm -r out.checked; fi
make -j $(nproc) -l $(nproc) --output-sync CC="${{env.builddir}}/bin/clang" -k 2>&1 | ${{github.workspace}}/depsfolder/actions/filter-bounds-inference-errors.py

test_TinyBigNum_expand_macros_alltypes_only_l_sol:
name: Test TinyBigNum (macro-expanded, -alltypes, least solution)
needs: build_3c
runs-on: self-hosted
steps:
- name: Build TinyBigNum
run: |
mkdir -p ${{env.benchmark_conv_dir}}/expand_macros_alltypes_only_l_sol
cd ${{env.benchmark_conv_dir}}/expand_macros_alltypes_only_l_sol
tar -xvzf ${{env.benchmark_tar_dir}}/tiny-bignum-c.tar.gz
cd tiny-bignum-c
bear make -j $(nproc) -l $(nproc) --output-sync CC="${{env.builddir}}/bin/clang"

- name: Convert TinyBigNum
run: |
cd ${{env.benchmark_conv_dir}}/expand_macros_alltypes_only_l_sol/tiny-bignum-c
${{env.port_tools}}/convert_project.py \
--prog_name ${{env.builddir}}/bin/3c \
--extra-3c-arg=-alltypes \
--expand_macros_before_conversion \
--extra-3c-arg=-only-l-sol \
--project_path .

- name: Copy 3c stats of TinyBigNum
run: |
cd ${{env.benchmark_conv_dir}}/expand_macros_alltypes_only_l_sol/tiny-bignum-c
mkdir 3c_performance_stats/
cp *.json 3c_performance_stats/

- name: Upload 3c stats of TinyBigNum
uses: actions/upload-artifact@v2
with:
name: TinyBigNum_expand_macros_alltypes_only_l_sol
path: ${{env.benchmark_conv_dir}}/expand_macros_alltypes_only_l_sol/tiny-bignum-c/3c_performance_stats/
retention-days: 5

- name: Build converted TinyBigNum (filter bounds inference errors)
run: |
cd ${{env.benchmark_conv_dir}}/expand_macros_alltypes_only_l_sol/tiny-bignum-c
if [ -e "out.checked" ]; then cp -r out.checked/* . && rm -r out.checked; fi
make -j $(nproc) -l $(nproc) --output-sync CC="${{env.builddir}}/bin/clang" -k 2>&1 | ${{github.workspace}}/depsfolder/actions/filter-bounds-inference-errors.py

test_Olden_no_expand_macros_alltypes_only_g_sol:
name: Test Olden (not macro-expanded, -alltypes, greatest solution)
needs: build_3c
Expand Down
Loading