ONNX Runtime Mobile Pre-Built Package Operator and Type Support
Supported operators and types
The supported operators and types are based on what is required to support float32 and quantized versions of popular models. The full list of input models used to determine this list is available here
Supported data input types
- float
- int8_t
- uint8_t
NOTE: Operators used to manipulate dimensions and indices will support int32 and int64.
Supported Operators
| Operator | Opsets |
|---|---|
| ai.onnx | |
| ai.onnx:Abs | 12, 13, 14, 15 |
| ai.onnx:Add | 12, 13, 14, 15 |
| ai.onnx:And | 12, 13, 14, 15 |
| ai.onnx:ArgMax | 12, 13, 14, 15 |
| ai.onnx:ArgMin | 12, 13, 14, 15 |
| ai.onnx:AveragePool | 12, 13, 14, 15 |
| ai.onnx:Cast | 12, 13, 14, 15 |
| ai.onnx:Ceil | 12, 13, 14, 15 |
| ai.onnx:Clip | 12, 13, 14, 15 |
| ai.onnx:Concat | 12, 13, 14, 15 |
| ai.onnx:ConstantOfShape | 12, 13, 14, 15 |
| ai.onnx:Conv | 12, 13, 14, 15 |
| ai.onnx:ConvTranspose | 12, 13, 14, 15 |
| ai.onnx:Cos | 12, 13, 14, 15 |
| ai.onnx:CumSum | 12, 13, 14, 15 |
| ai.onnx:DepthToSpace | 12, 13, 14, 15 |
| ai.onnx:DequantizeLinear | 12, 13, 14, 15 |
| ai.onnx:Div | 12, 13, 14, 15 |
| ai.onnx:DynamicQuantizeLinear | 12, 13, 14, 15 |
| ai.onnx:Elu | 12, 13, 14, 15 |
| ai.onnx:Equal | 12, 13, 14, 15 |
| ai.onnx:Erf | 12, 13, 14, 15 |
| ai.onnx:Exp | 12, 13, 14, 15 |
| ai.onnx:Expand | 12, 13, 14, 15 |
| ai.onnx:Flatten | 12, 13, 14, 15 |
| ai.onnx:Floor | 12, 13, 14, 15 |
| ai.onnx:Gather | 12, 13, 14, 15 |
| ai.onnx:GatherND | 12, 13, 14, 15 |
| ai.onnx:Gemm | 12, 13, 14, 15 |
| ai.onnx:GlobalAveragePool | 12, 13, 14, 15 |
| ai.onnx:Greater | 12, 13, 14, 15 |
| ai.onnx:GreaterOrEqual | 12, 13, 14, 15 |
| ai.onnx:HardSigmoid | 12, 13, 14, 15 |
| ai.onnx:Identity | 12, 13, 14, 15 |
| ai.onnx:If | 12, 13, 14, 15 |
| ai.onnx:InstanceNormalization | 12, 13, 14, 15 |
| ai.onnx:LRN | 12, 13, 14, 15 |
| ai.onnx:LayerNormalization | 1 |
| ai.onnx:LeakyRelu | 12, 13, 14, 15 |
| ai.onnx:Less | 12, 13, 14, 15 |
| ai.onnx:LessOrEqual | 12, 13, 14, 15 |
| ai.onnx:Log | 12, 13, 14, 15 |
| ai.onnx:LogSoftmax | 12, 13, 14, 15 |
| ai.onnx:Loop | 12, 13, 14, 15 |
| ai.onnx:MatMul | 12, 13, 14, 15 |
| ai.onnx:MatMulInteger | 12, 13, 14, 15 |
| ai.onnx:Max | 12, 13, 14, 15 |
| ai.onnx:MaxPool | 12, 13, 14, 15 |
| ai.onnx:Mean | 12, 13, 14, 15 |
| ai.onnx:Min | 12, 13, 14, 15 |
| ai.onnx:Mul | 12, 13, 14, 15 |
| ai.onnx:Neg | 12, 13, 14, 15 |
| ai.onnx:NonMaxSuppression | 12, 13, 14, 15 |
| ai.onnx:NonZero | 12, 13, 14, 15 |
| ai.onnx:Not | 12, 13, 14, 15 |
| ai.onnx:Or | 12, 13, 14, 15 |
| ai.onnx:PRelu | 12, 13, 14, 15 |
| ai.onnx:Pad | 12, 13, 14, 15 |
| ai.onnx:Pow | 12, 13, 14, 15 |
| ai.onnx:QLinearConv | 12, 13, 14, 15 |
| ai.onnx:QLinearMatMul | 12, 13, 14, 15 |
| ai.onnx:QuantizeLinear | 12, 13, 14, 15 |
| ai.onnx:Range | 12, 13, 14, 15 |
| ai.onnx:Reciprocal | 12, 13, 14, 15 |
| ai.onnx:ReduceMax | 12, 13, 14, 15 |
| ai.onnx:ReduceMean | 12, 13, 14, 15 |
| ai.onnx:ReduceMin | 12, 13, 14, 15 |
| ai.onnx:ReduceProd | 12, 13, 14, 15 |
| ai.onnx:ReduceSum | 12, 13, 14, 15 |
| ai.onnx:Relu | 12, 13, 14, 15 |
| ai.onnx:Reshape | 12, 13, 14, 15 |
| ai.onnx:Resize | 12, 13, 14, 15 |
| ai.onnx:ReverseSequence | 12, 13, 14, 15 |
| ai.onnx:Round | 12, 13, 14, 15 |
| ai.onnx:Scan | 12, 13, 14, 15 |
| ai.onnx:ScatterND | 12, 13, 14, 15 |
| ai.onnx:Shape | 12, 13, 14, 15 |
| ai.onnx:Sigmoid | 12, 13, 14, 15 |
| ai.onnx:Sin | 12, 13, 14, 15 |
| ai.onnx:Size | 12, 13, 14, 15 |
| ai.onnx:Slice | 12, 13, 14, 15 |
| ai.onnx:Softmax | 12, 13, 14, 15 |
| ai.onnx:SpaceToDepth | 12, 13, 14, 15 |
| ai.onnx:Split | 12, 13, 14, 15 |
| ai.onnx:Sqrt | 12, 13, 14, 15 |
| ai.onnx:Squeeze | 12, 13, 14, 15 |
| ai.onnx:Sub | 12, 13, 14, 15 |
| ai.onnx:Sum | 12, 13, 14, 15 |
| ai.onnx:Tanh | 12, 13, 14, 15 |
| ai.onnx:ThresholdedRelu | 12, 13, 14, 15 |
| ai.onnx:Tile | 12, 13, 14, 15 |
| ai.onnx:TopK | 12, 13, 14, 15 |
| ai.onnx:Transpose | 12, 13, 14, 15 |
| ai.onnx:Unique | 12, 13, 14, 15 |
| ai.onnx:Unsqueeze | 12, 13, 14, 15 |
| ai.onnx:Where | 12, 13, 14, 15 |
| com.microsoft | |
| com.microsoft:DynamicQuantizeMatMul | 1 |
| com.microsoft:FusedConv | 1 |
| com.microsoft:FusedGemm | 1 |
| com.microsoft:FusedMatMul | 1 |
| com.microsoft:Gelu | 1 |
| com.microsoft:MatMulIntegerToFloat | 1 |
| com.microsoft:NhwcMaxPool | 1 |
| com.microsoft:QLinearAdd | 1 |
| com.microsoft:QLinearAveragePool | 1 |
| com.microsoft:QLinearConv | 1 |
| com.microsoft:QLinearGlobalAveragePool | 1 |
| com.microsoft:QLinearLeakyRelu | 1 |
| com.microsoft:QLinearMul | 1 |
| com.microsoft:QLinearSigmoid | 1 |