(RE) Error in Aggregate Tokenizer for multilingual ASR 
** i re-posted in feature request form since there was no reply in bug report

Hello,
I built Multilingual ASR model with Korean and English.
However, I found that tokens are assigned not correctly.

I used 128 tokens for english, and 1641 tokens for korean (Total 1749)
when i checked vocabulary, there were several suspicious points.

When i printed asr_model.tokenizer.langs_by_token_id, it correctly shows tokens. (from 0 to 128 : 'en', from 129 to 1749: 'kor').
However, some alphabet token is assigned in korean. For example, print(asr_model.tokenizer.token_to_id('q', 'kor')) results 1702.

Also, in my knowledge, the aggregated tokenizer must remove duplicated token such as 'unkown'. But, there is two 'unk' tokens in both index 0 and 128

I also saw same phenomonon in pretrained_model, Conformer_transducer_enes_large.

tokens such as 'pre', 'ble' 'is', 'to' etc are assigned in Es, not En. I think these tokens are close to english tokens rather than spanish token.

there were two 'unk' tokens.
print(asr_model.tokenizer.token_to_id('unk', 'en')) results in 0, and
print(asr_model.tokenizer.token_to_id('unk', 'es')) results in 1024.