How can i get the word representation using BERT?
I need to get the embeddings using BERT for word-level, not sub-word . I got a lot of functions one of them gets the embeddings from the last layers in the model but the results for sub-word . How can I start, please? I hope someone can help . Appreciating your time
2022-01-16T11:00:38Z
This previous discussion can be usefulObtaining word-embeddings from Roberta
2022-01-16T11:01:26Z
This might help:Generate raw word embeddings using transformer models like BERT for downstream process - #2 by BramVanroy