The helper function runner.run_benchmarks does not offer a way to run the benchmarks with an external set of framework configurations.
I want to run dpbench in batch mode with a set of framework configs that change the sycl_device attribute. However, as the runner.run_benchmarks only reads configs from the default location, I cannot submit multiple jobs where each job has a different sycl_device.
The helper function
runner.run_benchmarksdoes not offer a way to run the benchmarks with an external set of framework configurations.I want to run dpbench in batch mode with a set of framework configs that change the
sycl_deviceattribute. However, as therunner.run_benchmarksonly reads configs from the default location, I cannot submit multiple jobs where each job has a differentsycl_device.