`ValueError: 'p' is not in list`
I followed the code that exists in this post by BramVanroyGenerate raw word embeddings using transformer models like BERT for downstream process - #2 by BramVanroyto get the embeddings for each word but if have a file that contains more than 20.000 sentences and gets a lot of tokens that throw like this errorValueError: 'p' is not in listfrom the list which returnsent.split() ['smoke', 'coming', 'out', 'of', 'stack', 'with', 'green', 'traffic', 'light', 'and', 'picture', 'of', 'mr', 'peanut', 'on', 'building']phere error from wordpeanutI am already can add new-token but manually how can I make if the condition on the word if it does not exist then add new_token of the word from the list