How to change the batch size of a pretrained model?
Hey friends! Just wondering a simple questionGiven a pretrained model, can I change the batch size?eg:from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("gpt2")

model = AutoModelForCausalLM.from_pretrained("gpt2")Cant find any documentation on how to do so, thanks!
2022-08-25T06:17:29Z
Hi@alpyne,Did you find an answer for this?