How to enable kenlm weight accounting with Conformer-CTC acoustic model on BPE tokens?
Trained Conformer-CTC on BPE tokens, tried to make a prediction based on kenlm. But all the predictions turned out to be just nonsense from one word.

As I understand it, this is due to the fact that models on BPE tokens return an underscore instead of a space.
Tell me, can this problem be somehow elegantly solved in order to use kenlm with an acoustic model on BPE?

From thoughts, can kenlm be trained on texts where there is an underscore instead of a space? But that doesn't seem to work...