Can a language model trained using transformer_lm be used with beam_search_decoder?
You may have N-gram LM with beam search decoder or just beam search decoder without N-gram to produce some top candidates, then use the Transformer LM as a Neural Rescorer to rescore the candidates. Then the scores from Neural Rescorer can get weighted average with scores from beam search decoder to produce the final scores. Please take a look here:
https://docs.nvidia.com/deeplearning/nemo/user-guide/docs/en/v1.0.0/asr/asr_language_modeling.html Thank you!
I have seen a pipeline is coming for this, but just wanted to check in on current state, thanks so much!