Trainer.push_to_hub is taking lot of time, is this expected behaviour?
Hi, I’m trying to push my model to HF hub via trainer.push_to_hub and I see that it is taking a lot of time. Is this the expected behaviour?below are the o/pSaving model checkpoint to xlm-roberta-baseConfiguration saved in xlm-roberta-base/config.jsonModel weights saved in xlm-roberta-base/pytorch_model.bintokenizer config file saved in xlm-roberta-base/tokenizer_config.jsonSpecial tokens file saved in xlm-roberta-base/special_tokens_map.jsonSeveral commits (2) will be pushed upstream.The progress bars may be unreliable.
2022-01-27T12:45:56Z
@sguggercan you please help me out with this error?
2022-01-27T18:18:38Z
What error are you seeing? Pushing to the hub may take time if you have an unreliable connection, it all depends on the internet speed.
2022-01-28T12:09:00Z
Thank you, I figured that the error occurs when I mount the drive(maybe that’s when push_to_hub causes an issue), now that I keep the data in collab itself, it’s no longer an issue.
2022-02-04T05:32:29Z
Thanks for this, spent hours trying to push to hub from colab drive and was not working. maybe something to flag as part of the course.
2022-12-07T15:30:25Z
Can you please explain what you mean by this? How would I do this with Image data?
2023-08-16T10:23:18Z
I also ran into this problem. It resolved itself when I deleted some of the models that I had previously pushed to hub. Hope it can help someone in the future.
2023-10-18T19:06:27Z
That’s a good catch! thanks for sharing your findings and helping to identify the source of the problem.