ONNX Runtime Mobile Pre-Built Package Operator and Type Support

Supported operators and types

The supported operators and types are based on what is required to support float32 and quantized versions of popular models. The full list of input models used to determine this list is available here

Supported data input types

  • float
  • int8_t
  • uint8_t

NOTE: Operators used to manipulate dimensions and indices will support int32 and int64.

Supported Operators

Operator Opsets
ai.onnx  
ai.onnx:Abs 12, 13, 14, 15
ai.onnx:Add 12, 13, 14, 15
ai.onnx:And 12, 13, 14, 15
ai.onnx:ArgMax 12, 13, 14, 15
ai.onnx:ArgMin 12, 13, 14, 15
ai.onnx:AveragePool 12, 13, 14, 15
ai.onnx:Cast 12, 13, 14, 15
ai.onnx:Ceil 12, 13, 14, 15
ai.onnx:Clip 12, 13, 14, 15
ai.onnx:Concat 12, 13, 14, 15
ai.onnx:ConstantOfShape 12, 13, 14, 15
ai.onnx:Conv 12, 13, 14, 15
ai.onnx:ConvTranspose 12, 13, 14, 15
ai.onnx:Cos 12, 13, 14, 15
ai.onnx:CumSum 12, 13, 14, 15
ai.onnx:DepthToSpace 12, 13, 14, 15
ai.onnx:DequantizeLinear 12, 13, 14, 15
ai.onnx:Div 12, 13, 14, 15
ai.onnx:DynamicQuantizeLinear 12, 13, 14, 15
ai.onnx:Elu 12, 13, 14, 15
ai.onnx:Equal 12, 13, 14, 15
ai.onnx:Erf 12, 13, 14, 15
ai.onnx:Exp 12, 13, 14, 15
ai.onnx:Expand 12, 13, 14, 15
ai.onnx:Flatten 12, 13, 14, 15
ai.onnx:Floor 12, 13, 14, 15
ai.onnx:Gather 12, 13, 14, 15
ai.onnx:GatherND 12, 13, 14, 15
ai.onnx:Gemm 12, 13, 14, 15
ai.onnx:GlobalAveragePool 12, 13, 14, 15
ai.onnx:Greater 12, 13, 14, 15
ai.onnx:GreaterOrEqual 12, 13, 14, 15
ai.onnx:HardSigmoid 12, 13, 14, 15
ai.onnx:Identity 12, 13, 14, 15
ai.onnx:If 12, 13, 14, 15
ai.onnx:InstanceNormalization 12, 13, 14, 15
ai.onnx:LRN 12, 13, 14, 15
ai.onnx:LayerNormalization 1
ai.onnx:LeakyRelu 12, 13, 14, 15
ai.onnx:Less 12, 13, 14, 15
ai.onnx:LessOrEqual 12, 13, 14, 15
ai.onnx:Log 12, 13, 14, 15
ai.onnx:LogSoftmax 12, 13, 14, 15
ai.onnx:Loop 12, 13, 14, 15
ai.onnx:MatMul 12, 13, 14, 15
ai.onnx:MatMulInteger 12, 13, 14, 15
ai.onnx:Max 12, 13, 14, 15
ai.onnx:MaxPool 12, 13, 14, 15
ai.onnx:Mean 12, 13, 14, 15
ai.onnx:Min 12, 13, 14, 15
ai.onnx:Mul 12, 13, 14, 15
ai.onnx:Neg 12, 13, 14, 15
ai.onnx:NonMaxSuppression 12, 13, 14, 15
ai.onnx:NonZero 12, 13, 14, 15
ai.onnx:Not 12, 13, 14, 15
ai.onnx:Or 12, 13, 14, 15
ai.onnx:PRelu 12, 13, 14, 15
ai.onnx:Pad 12, 13, 14, 15
ai.onnx:Pow 12, 13, 14, 15
ai.onnx:QLinearConv 12, 13, 14, 15
ai.onnx:QLinearMatMul 12, 13, 14, 15
ai.onnx:QuantizeLinear 12, 13, 14, 15
ai.onnx:Range 12, 13, 14, 15
ai.onnx:Reciprocal 12, 13, 14, 15
ai.onnx:ReduceMax 12, 13, 14, 15
ai.onnx:ReduceMean 12, 13, 14, 15
ai.onnx:ReduceMin 12, 13, 14, 15
ai.onnx:ReduceProd 12, 13, 14, 15
ai.onnx:ReduceSum 12, 13, 14, 15
ai.onnx:Relu 12, 13, 14, 15
ai.onnx:Reshape 12, 13, 14, 15
ai.onnx:Resize 12, 13, 14, 15
ai.onnx:ReverseSequence 12, 13, 14, 15
ai.onnx:Round 12, 13, 14, 15
ai.onnx:Scan 12, 13, 14, 15
ai.onnx:ScatterND 12, 13, 14, 15
ai.onnx:Shape 12, 13, 14, 15
ai.onnx:Sigmoid 12, 13, 14, 15
ai.onnx:Sin 12, 13, 14, 15
ai.onnx:Size 12, 13, 14, 15
ai.onnx:Slice 12, 13, 14, 15
ai.onnx:Softmax 12, 13, 14, 15
ai.onnx:SpaceToDepth 12, 13, 14, 15
ai.onnx:Split 12, 13, 14, 15
ai.onnx:Sqrt 12, 13, 14, 15
ai.onnx:Squeeze 12, 13, 14, 15
ai.onnx:Sub 12, 13, 14, 15
ai.onnx:Sum 12, 13, 14, 15
ai.onnx:Tanh 12, 13, 14, 15
ai.onnx:ThresholdedRelu 12, 13, 14, 15
ai.onnx:Tile 12, 13, 14, 15
ai.onnx:TopK 12, 13, 14, 15
ai.onnx:Transpose 12, 13, 14, 15
ai.onnx:Unique 12, 13, 14, 15
ai.onnx:Unsqueeze 12, 13, 14, 15
ai.onnx:Where 12, 13, 14, 15
   
com.microsoft  
com.microsoft:DynamicQuantizeMatMul 1
com.microsoft:FusedConv 1
com.microsoft:FusedGemm 1
com.microsoft:FusedMatMul 1
com.microsoft:Gelu 1
com.microsoft:MatMulIntegerToFloat 1
com.microsoft:NhwcMaxPool 1
com.microsoft:QLinearAdd 1
com.microsoft:QLinearAveragePool 1
com.microsoft:QLinearConv 1
com.microsoft:QLinearGlobalAveragePool 1
com.microsoft:QLinearLeakyRelu 1
com.microsoft:QLinearMul 1
com.microsoft:QLinearSigmoid 1