title: Where can I get the pretrained word embeddinngs for BERT?
body: <p>I know that BERT has total vocabulary size of 30522 which contains some words and subwords. I want to get the initial input embeddings of BERT. So, my requirement is to get the table of size <code>[30522, 768]</code> to which I can index by token id to get its embeddings. Where can I get this table?</p>