Unable to reproduce cache aware streaming results for Conformer that were there for Fastconformer.
I will try to look into this issue next week. It can be due to something broken in the cache-aware streaming script. Have you tried some of the already pretrained cache-aware models? Do they work properly?

You may use cache-aware with nemo but as far as I know, they are not supported in Riva yet. It is a work in progress. For now, you may use nemo for streaming cache-aware models.

You may take a look at this tutorial on how to use cache-aware models:
https://github.com/NVIDIA/NeMo/blob/main/tutorials/asr/Online_ASR_Microphone_Demo_Cache_Aware_Streaming.ipynb

Would you please try this tutorial and let me know if it works properly or not for your model?

 @VahidooX , I went through the tutorial already. I fine-tuned a model using the streaming config. When I infer the model offline it works, but when I put that model in a streaming setup I get the above results. I will attach videos in a moment Is it a confirmer or fastconformer?
Have you tried this script?

https://github.com/NVIDIA/NeMo/blob/main/examples/asr/asr_cache_aware_streaming/speech_to_text_cache_aware_streaming_infer.py This issue is stale because it has been open for 30 days with no activity. Remove stale label or comment or this will be closed in 7 days. This issue was closed because it has been inactive for 7 days since being marked as stale.
I trained Conformer-CTC using cache aware method. but unable to reproduce the results that were there with "Fastconformer cache aware streaming". By using Conformer-CTC cache aware method i get partial sub-words, words combined together like ("hello world" ==> herld) , in streaming output.

the same was the case when i deployed it in a RIVA pipeline.

but when i use the "transcribe" function i get proper transcription for the audio file.
@titu1994 @VahidooX
can you please enlighten on this.
When to use and how to use streaming models in .nemo format and in RIVA pipeline.
My question has some relevance with these issues
[https://github.com/https://github.com/NVIDIA/NeMo/discussions/7010]
[https://github.com/https://github.com/NVIDIA/NeMo/discussions/5284]