BENCHMARKS.md

Benchmark Guide

Table of Contents

• ISPD 2016/2017 Benchmarks
  • Obtaining Benchmarks
  • Setting Up Benchmarks
  • Running Benchmarks
  • Configuration Options
  • Vivado Flow Integration

ISPD 2016/2017 Benchmarks

Obtaining Benchmarks

Download benchmark files from:

• ISPD 2016 FPGA Placement Benchmarks [Google Drive / Baidu Drive]

• ISPD 2016 FPGA Placement Flexshelf Benchmarks [Google Drive / Baidu Drive]

• ISPD 2017 FPGA Placement Benchmarks [Google Drive / Baidu Drive]

• ISPD 2017 FPGA Placement Flexshelf Benchmarks [Google Drive / Baidu Drive]

Extract to <benchmark directory> with structure:

<benchmark directory>
├── ispd2016
├── ispd2016_flexshelf
├── ispd2017
├── ispd2017_flexshelf

Setting Up Benchmarks

Link benchmark folders to installation directory:

ln -s <benchmark directory>/ispd2016 <installation directory>/benchmarks/ispd2016
ln -s <benchmark directory>/ispd2016_flexshelf <installation directory>/benchmarks/ispd2016_flexshelf
ln -s <benchmark directory>/ispd2017 <installation directory>/benchmarks/ispd2017
ln -s <benchmark directory>/ispd2017_flexshelf <installation directory>/benchmarks/ispd2017_flexshelf

Running Benchmarks

Single benchmark:

cd <installation directory>
python openparf.py --config unittest/regression/ispd2016/FPGA01.json

Batch processing:

cd <installation directory>
<source directory>/scripts/run_ispd2016_benchmark.sh # ISPD 2016
<source directory>/scripts/run_ispd2016_flexshelf_benchmark.sh # ISPD 2016 Flexshelf
<source directory>/scripts/run_ispd2017_benchmark.sh # ISPD 2017
<source directory>/scripts/run_ispd2017_flexshelf_benchmark.sh # ISPD 2017 Flexshelf

Configuration Options

Common parameters in JSON config files:

• gpu: Enable GPU acceleration (Default: 0)
• result_dir: Results directory
• route_flag: Enable router (Default: 0)
• slr_aware_flag: Enable multi-die placer (Default: 1)

See openparf/params.json for all available parameters.

Vivado Flow Integration

For placement evaluation using Vivado:

1. Disable routing by setting route_flag: 0
2. Find placement results in <result dir>/<benchmark name>.pl
3. Follow ISPD 2016/2017 instructions for Vivado integration