title: Google's BERT for NLP: replace foreign characters in vocab.txt to add words?
body: <p>I am fine-tuning the BERT model but need to add a few thousand words. I know that one can replace the ~1000 <code>[unused#]</code> lines at the top of the vocab.txt, but I also notice there are thousands of single foreign characters (unicode) in the file, which I will never use. For fine-tuning, is it possible to replace those with my words, fine tune, and have model still work correctly?</p>