OOM when allocating using BERT
i got this problem with using embedding for 150.000 sentences using BERT modeltensorflow.python.framework.errors_impl.ResourceExhaustedError:  OOM when allocating tensor with shape[1619381,768] and type float on  /job:localhost/replica:0/task:0/device:GPU:0 by allocator GPU_0_bfc  [Op:RandomUniform]as the layer of embedding isembed = Embedding(1619381, 768, mask_zero=True)(sentence)i got this number1619381fromembeddings = torch.cat(embeddings,dim=0)which contains all embedding for 150.000 sentences .
2022-02-05T00:45:59Z
is there any help please