Convert rnnt asr model to tensorrt
I am working on converting the RNNT model to tensorrt for my application and I have convert the torch model to ONNX as suggested. However, I am stuck on converting ONNX to trt model right now. I tried lots of methods and still failed. Is it possible to convert? Did anyone succeed on converting this model to tensorrt? Which tensorrt version should I use or how can I do the conversion? Any tutorials?
