NASBench

NASBench is a built-in problem based on NAS-Bench-101: Towards Reproducible Neural Architecture Search. The official Python implementation of NAS-Bench-101 can be found here.

How to setup the dataset file for NASBench problem

This problem requires to download a dataset file and convert it to the binary format for kurobako. Please execute the following commands to set up the dataset file before running benchmarks.

// Download dataset file.
$ curl -L $(kurobako dataset nasbench url) -o nasbench_full.tfrecord

// Convert the TFRecord format file to the binary file that can be loaded by kurobako.
$ kurobako dataset nasbench convert nasbench_full.tfrecord nasbench_full.bin

You can specify the dataset file as follows:

// Create a NASBench problem recipe.
$ kurobako problem nasbench nasbench_full.bin