Run multiple model inference on a single GPU concurrently
Hello nemo team,

I have a queue of audio files waiting to be transcribed. when I run the citrinet model on them I see there's still free memory on the gpu hence my question - is there a way and how, to run multiple nemo models (can be all citrinet for example, but also others) concurrently on a single gpu? 

btw unrelated: is there a compatible pretrained LM model for bpe models (citrinet)? also is downsampling needed/important for audio files higher than 16kHz ? (22, 41..) so far it seems to handle them well.

Thank you 😊 