TNBS: A Kernel-Based Benchmarking for Digital Quantum Computers

Abstract

[Abstract]: The systematic evaluation of the performance of Quantum Computers allows users to identify the best platform to execute a certain class of workload, and it can also guide the future developments of hardware companies. The NEASQC Benchmark Suite (TNBS) is a methodology designed in the context of the NEASQC (NExt ApplicationS of Quantum Computing) European project to perform such evaluation across several benchmark cases identified as common in one or several domains of application of Quantum Computing. TNBS follows several design principles identified as relevant after a thorough evaluation of the existing benchmarking methodologies: (1) benchmarks are defined at high-level not being linked to any algorithmic approach or implementation, (2) benchmarks are scalable (in qubits) and their output is classically verifiable, (3) performance metrics may be defined per case to fit the nature of the outputs of each case, and (4) the benchmark report also keeps record of all the relevant components of the execution stack. Finally, in the future, the reports may be submitted to a centralized repository, which is equipped with a web interface allowing a systematic and objective comparison of different platforms across the different cases. The first release of TNBS is composed of 4 benchmark cases and provides a reference implementation in myQLM. Documentation and code are available at https://github.com/NEASQC/WP3_Benchmark.