Arm® KleidiAI™ software compatibility in ONNX Runtime
This page outlines support details for the Arm KleidiAI software micro-kernel library. Micro-kernels are integrated into ONNX Runtime via Microsoft Linear Algebra Subprograms (MLAS) to support CPU-based inference acceleration on Arm-based CPUs.
Arm, Kleidi, KleidiAI, KleidiCV and Kleidi Libraries are registered trademarks or trademarks of Arm Limited (or its subsidiaries or affiliates) in the US and/or elsewhere.
Eligible ONNX operators are a conservative set traced directly from integrated MLAS paths. Actual acceleration also depends on datatype, shape, CPU features, packing, and runtime configuration.
Compatibility table
Loading compatibility data…