Multilingual Neural Machine Translation (MNMT) inference time
How to improve the MNMT inference time?
2022-03-08T17:30:52Z
If you are using cloud computing, you can use EIA as a cheap solution. Need more information on how you are doing inference now
2022-03-08T18:20:34Z
Hi,Thanks for ur response.I m using ctranslate2 inference engine.GitHubGitHub - OpenNMT/CTranslate2: Fast inference engine for Transformer modelsFast inference engine for Transformer models. Contribute to OpenNMT/CTranslate2 development by creating an account on GitHub.
2022-03-09T15:34:13Z
How does it relate totransformersthen?
2022-03-09T15:52:34Z
I trained Multilingual neural machine translation using transformer architecture with fairseq toolkit. I converted fairseq model to ctranslate2 model using ctranslate2 converter. I want to improve the inference time of my model. Can you pls help?
2022-03-13T19:43:55Z
But you are not using any of the Hugging Face tools? These forums are not for the architecturetransformerbut for the libraries of Hugging Face, amongst which thetransformerspackage.You’ll have better look asking this question on theFairseqandOpenNMT forums.