Sentence Piece tokenizer from script "process_asr_text_tokenizer"
I was finetuning  pretrained citrinet 512 model (Encoder Freeze) for filipino language where i trained a custom tokenizer with vocab size - 1024 and replaced the pretrained citrinet tokenizer section with my custom tokenizer.

`data_dir = "."
!python3 ./scripts/process_asr_text_tokenizer.py  
  --manifest="{data_dir}/Filipino/train_manifest.json"
  --data_root="{data_dir}/complete_tg/tokenizers/tokenizer_1/" 
  --vocab_size=1024 
  --tokenizer="spe" 
  --spe_type="bpe" 
  --spe_character_coverage=1.0 
  --log` 

Sample vocab -: 

▁
##a
##i
##o
##n
##t
##c
##e
##l
##r
##s
##p
##f
##g
##k
##m
##v


This script gives tokenizer.model and vocabulary, In vocab a special character "▁" is present. This is not a normal underscore which is "_".

Can someone explain me why i am getting this special token as due to this special character i am unable to deploy my asr in riva speech with flashlight decoder.
Error got during deployment with flashlight decoder -:

`I0712 13:32:15.565105 94 ctc-decoder-library.cc:23] TRITONBACKEND_ModelInstanceInitialize: nemo_asr_riva_pipeline_filipino-ctc-decoder-cpu-streaming_0 (device 0)
terminate called after throwing an instance of 'std::runtime_error'
  what():  [LoadWords] Invalid line: ▁
  > Riva waiting for Triton server to load all models...retrying in 1 second
/opt/riva/bin/start-riva: line 4:    94 Aborted                 (core dumped) tritonserver --log-verbose=0 --strict-model-config=true $model_repos --cuda-memory-pool-byte-size=0:1000000000`
