Is last_hidden_state the output of Encoder block?
When we useBertModel.forward(), is thelast_hidden_statethe output of Encoder in Transformers block?
2021-12-23T17:47:23Z
Yes! It’s a tensor of shape (batch_size, seq_len, hidden_size).