Question about adafactor trainer
I’m new to huggingface and currently I want to build a customized adafactor optimizer. The problem is that whenever I change the setting to relative_step = True, the trainer throws error when trying to save trainer_state.json. Here is the error screenshotimage1817×338 31.9 KBWhen I set the lr to constant, there won’t be any error. I wonder how to solve this and is this a problem with adafactor?Here is my codeimage1028×775 40.8 KB
2023-02-14T10:23:55Z
I see that the optim in the TrainingArguments is marked out. Is it intentional, is it needed there or not?