supporting LSTM, GRU

[elfman2]

nothing more to say

[Gaudeval]

Some references for LSTM:

• Wikipedia page on LSTM
• ONNX LSTM Operatator definition
• This Presentation from Khronos on implementing the LSTM (in OpenVX) has the formula
• Illustrated introduction to the LSTM cell
• rust implementation in tract

The Wikipedia page on GRU should have the required information. Also consider the ONNX GRU Operator definition.

[elfman2]

SONNX LSTM specification (draft)

[elfman2]

Decomposing LSTM into MatMuls and activations provides support to quantization. Maybe a preprocessing onnxscript or keras3.0 exporter might do the job.