Does setting max_seq_length to a too large number for fine tuning LLM using SFTTrainer affects model training?
Hi, i was trying to finetune mistral 7B model using a custom dataset. I was just wondering if setting a too large max_seq_length will affect the training and lead to a bad fine-tuned model performance.To my understanding, the seq_length should be the tokenized text length, right? So too big a sequence length might lead too many paddings, but i wonder whether it will affect fine-tuning except for more memory usage.Many thanks!
2024-12-06T19:45:52Z
I also want to know, did you find an answer?