Unable to download models from HF with from_pretrained()
I am trying to download the model TheBloke/Llama-2-7b-Chat-GGUF with transformers with the code presented in the model card:Load model directlyfrom transformers import AutoModelmodel = AutoModel.from_pretrained(“TheBloke/Llama-2-7b-Chat-GGUF”)This produces an error message:Traceback (most recent call last):File “C:\Users\nikoo\PycharmProjects\langmodel\main.py”, line 3, inmodel = AutoModel.from_pretrained(“TheBloke/Llama-2-7b-Chat-GGUF”)File “C:\Users\nikoo\PycharmProjects\langmodel\venv\lib\site-packages\transformers\models\auto\auto_factory.py”, line 563, in from_pretrainedreturn model_class.from_pretrained(File “C:\Users\nikoo\PycharmProjects\langmodel\venv\lib\site-packages\transformers\modeling_utils.py”, line 2846, in from_pretrainedraise EnvironmentError(OSError: TheBloke/Llama-2-7b-Chat-GGUF does not appear to have a file named pytorch_model.bin, tf_model.h5, model.ckpt or flax_model.msgpack.I understand that it wants one of those files, but they are not found in the repository.I am running a virtual environment with latest PyTorch and transformers 4.33.2 installed.
2023-10-26T20:42:33Z
Did you ever get this figured out?  I’m stuck on the same thing.
2023-12-07T08:44:46Z
I am facing the same issue. Anyone figured out yet?