KInference Core supported operators

ai.onnx

Common operators:

• Abs
• Acos
• Acosh
• Add
• And
• ArgMax
• ArgMin
• Asin
• Asinh
• Atan
• Atanh
• AveragePool
• BatchNormalization
• BitShift
• BitwiseAnd
• BitwiseNot
• BitwiseOr
• BitwiseXor
• Cast
• Ceil
• Col2Im
• Compress
• Concat
• ConcatFromSequence
• Constant
• ConstantOfShape
• Conv
• ConvInteger
• ConvTranspose
• Cos
• Cosh
• CumSum
• DFT
• DepthToSpace
• DequantizeLinear
• Det
• Div
• Dropout
• Einsum
• Equal
• Erf
• Exp
• Expand
• EyeLike
• Flatten
• Floor
• GRU
• Gather
• GatherElements
• GatherND
• Gemm
• GlobalAveragePool
• GlobalLpPool
• GlobalMaxPool
• Greater
• GridSample
• Hardmax
• Identity
• If
• InstanceNormalization
• IsInf
• IsNaN
• LRN
• LSTM
• Less
• Log
• Loop
• LpNormalization
• LpPool
• MatMul
• MatMulInteger
• Max
• MaxPool
• MaxRoiPool
• MaxUnpool
• Mean
• MelWeightMatrix
• Min
• Mod
• Mul
• Multinomial
• Neg
• NonMaxSuppression
• NonZero
• Not
• OneHot
• Optional
• OptionalGetElement
• OptionalHasElement
• Or
• Pad
• Pow
• QLinearConv
• QLinearMatMul
• QuantizeLinear
• RNN
• RandomNormal
• RandomNormalLike
• RandomUniform
• RandomUniformLike
• Reciprocal
• ReduceMax
• ReduceMean
• ReduceMin
• ReduceProd
• ReduceSum
• Reshape
• Resize
• ReverseSequence
• RoiAlign
• Round
• STFT
• Scan
• Scatter (deprecated)
• ScatterElements
• ScatterND
• SequenceAt
• SequenceConstruct
• SequenceEmpty
• SequenceErase
• SequenceInsert
• SequenceLength
• Shape
• Sigmoid
• Sign
• Sin
• Sinh
• Size
• Slice
• xSpaceToDepth
• Split
• SplitToSequence
• Sqrt
• Squeeze
• StringNormalizer
• Sub
• Sum
• Tan
• Tanh
• TfIdfVectorizer
• Tile
• TopK
• Transpose
• Trilu
• Unique
• Unsqueeze
• Upsample (deprecated)
• Where
• Xor

Functions:

• Bernoulli
• BlackmanWindow
• CastLike
• Celu
• CenterCropPad
• Clip
• DynamicQuantizeLinear
• Elu
• GreaterOrEqual
• GroupNormalization
• HammingWindow
• HannWindow
• HardSigmoid
• HardSwish
• LayerNormalization
• LeakyRelu
• LessOrEqual
• LogSoftmax
• MeanVarianceNormalization
• Mish
• NegativeLogLikelihoodLoss
• PRelu
• Range
• ReduceL1
• ReduceL2
• ReduceLogSum
• ReduceLogSumExp
• ReduceSumSquare
• Relu
• Selu
• SequenceMap
• Shrink
• Softmax
• SoftmaxCrossEntropyLoss
• Softplus
• Softsign
• ThresholdedRelu

ai.onnx.ml

• ai.onnx.ml.ArrayFeatureExtractor
• ai.onnx.ml.Binarizer
• ai.onnx.ml.CastMap
• ai.onnx.ml.CategoryMapper
• ai.onnx.ml.DictVectorizer
• ai.onnx.ml.FeatureVectorizer
• ai.onnx.ml.Imputer
• ai.onnx.ml.LabelEncoder
• ai.onnx.ml.LinearClassifier
• ai.onnx.ml.LinearRegressor
• ai.onnx.ml.Normalizer
• ai.onnx.ml.OneHotEncoder
• ai.onnx.ml.SVMClassifier
• ai.onnx.ml.SVMRegressor
• ai.onnx.ml.Scaler
• ai.onnx.ml.TreeEnsembleClassifier
• ai.onnx.ml.TreeEnsembleRegressor
• ai.onnx.ml.ZipMap

com.microsoft

• Attention
• AttnLSTM
• BeamSearch
• BiasDropout
• BiasGelu
• BiasSoftmax
• BifurcationDetector
• BitmaskBiasDropout
• BitmaskDropout
• CDist
• ComplexMul
• ComplexMulConj
• ConvTransposeWithDynamicPads
• CropAndResize
• DecoderAttention
• DequantizeBFP
• DequantizeWithOrder
• DynamicQuantizeLSTM
• DynamicQuantizeMatMul
• EmbedLayerNormalization
• ExpandDims
• FastGelu
• FusedConv
• FusedGemm
• FusedMatMul
• Gelu
• GemmFastGelu
• GreedySearch
• GridSample
• Inverse
• Irfft
• LongformerAttention
• MatMulInteger16
• MatMulIntegerToFloat
• MaxpoolWithMask
• MulInteger
• MurmurHash3
• NGramRepeatBlock
• NhwcConv
• NhwcMaxPool
• QAttention
• QGemm
• QLinearAdd
• QLinearAveragePool
• QLinearConcat
• QLinearGlobalAveragePool
• QLinearLeakyRelu
• QLinearMul
• QLinearReduceMean
• QLinearSigmoid
• QLinearSoftmax
• QOrderedAttention
• QOrderedGelu
• QOrderedLayerNormalization
• QOrderedLongformerAttention
• QOrderedMatMul
• QuantizeBFP
• QuantizeWithOrder
• QuickGelu
• ReduceSumInteger
• RemovePadding
• RestorePadding
• Rfft
• SampleOp
• SkipLayerNormalization
• Snpe
• SparseToDenseMatMul
• Tokenizer
• TorchEmbedding
• TransposeMatMul
• Trilu
• Unique
• WordConvEmbedding
• IsAllFinite
• QEmbedLayerNormalization