A Collection of Neural Architecture Search Benchmarks

We present a collection of several Neural Architecture Search (NAS) Benchmarks in this repository. Please feel free to open an issue or pull requests to add relevant NAS Benchmark papers in case we missed any or any new NAS Benchmark when it is made public. This repository is maintained by Prof. Arun Somani's group at Iowa State University.

NAS Benchmarks for Computer Vision Applications (CNNs)

Benchmark	Paper	GitHub
NAS-Bench-101	Paper	URL
NAS-Bench-201	Paper	URL
NATS-Bench	Paper	URL
NAS-Bench-301	Paper	URL
NAS-Bench-1Shot1	Paper	URL
NAS-Bench-MR	Paper	URL
NAS-Bench-Macro	Paper	URL
TransNAS-Bench-101	Paper	URL
NAS-Bench-360	Paper	URL
NAS-Bench-x11	Paper	URL
NAS-Bench-Suite	Paper	URL
NAS-Bench-Suite-Zero	Paper	URL
BenchENAS	Paper	URL

NAS Benchmarks for Non Computer Vision Applications

Benchmark	Paper	GitHub
NAS-Bench-NLP	Paper	URL
NAS-Bench-ASR	Paper	URL
NAS-Bench-Graph	Paper	URL

Hardware-aware NAS Benchmarks

Benchmark	Paper	GitHub
LatBench	Paper	URL
HW-NAS-Bench	Paper	URL
BLOX	Paper	URL
EC-NAS-Bench	Paper	URL

NAS-HPO Benchmarks

Benchmark	Paper	GitHub
NAS-HPO-Bench	Paper	URL
NAS-HPO-Bench-II	Paper	URL
LCBench	Paper	URL

Survey Papers

Feel free to go through our previously published NAS survey papers:

Survey Title	Paper URL	PDF
Neural Architecture Search Benchmarks: Insights and Survey	Paper	PDF
Neural Architecture Search Survey: A Hardware Perspective	Paper	PDF
Neural Architecture Search for Transformers: A Survey	Paper	PDF

Citation

If you find our papers and the repository useful, please consider citing the following papers:

@article{chitty2023neural,
  title={Neural Architecture Search Benchmarks: Insights and Survey},
  author={Chitty-Venkata, Krishna Teja and Emani, Murali and Vishwanath, Venkatram and Somani, Arun K},
  journal={IEEE Access},
  volume={11},
  pages={25217--25236},
  year={2023},
  publisher={IEEE}
}

@article{chitty2022neural,
  title={Neural architecture search survey: A hardware perspective},
  author={Chitty-Venkata, Krishna Teja and Somani, Arun K},
  journal={ACM Computing Surveys},
  volume={55},
  number={4},
  pages={1--36},
  year={2022},
  publisher={ACM New York, NY}
}

@article{chitty2022neural_transformers,
  title={Neural architecture search for transformers: A survey},
  author={Chitty-Venkata, Krishna Teja and Emani, Murali and Vishwanath, Venkatram and Somani, Arun K},
  journal={IEEE Access},
  volume={10},
  pages={108374--108412},
  year={2022},
  publisher={IEEE}
}