ONNX Runtime
|
OpenVINO Provider Options. More...
#include <onnxruntime_c_api.h>
Public Member Functions | |
OrtOpenVINOProviderOptions () | |
Public Attributes | |
const char * | device_type |
Device type string. | |
unsigned char | enable_npu_fast_compile |
0 = disabled, nonzero = enabled | |
const char * | device_id |
size_t | num_of_threads |
0 = Use default number of threads | |
const char * | cache_dir |
void * | context |
unsigned char | enable_opencl_throttling |
0 = disabled, nonzero = enabled | |
unsigned char | enable_dynamic_shapes |
0 = disabled, nonzero = enabled | |
OpenVINO Provider Options.
This Struct is frozen since ORT 1.13.0. Its maintained part of Legacy API for compatibility.
For latest OpenVINO Provider Options update to the ProviderOptions map.
Latest OpenVINO Provider Options are listed in the onnxruntime document.
|
inline |
const char* OrtOpenVINOProviderOptions::cache_dir |
void* OrtOpenVINOProviderOptions::context |
const char* OrtOpenVINOProviderOptions::device_id |
const char* OrtOpenVINOProviderOptions::device_type |
Device type string.
Valid settings are one of: "CPU_FP32", "CPU_FP16", "GPU_FP32", "GPU_FP16"
unsigned char OrtOpenVINOProviderOptions::enable_dynamic_shapes |
0 = disabled, nonzero = enabled
unsigned char OrtOpenVINOProviderOptions::enable_npu_fast_compile |
0 = disabled, nonzero = enabled
unsigned char OrtOpenVINOProviderOptions::enable_opencl_throttling |
0 = disabled, nonzero = enabled
size_t OrtOpenVINOProviderOptions::num_of_threads |
0 = Use default number of threads