Inference, checkpoint
Hello,I’m in the process of fine-tuning a model with peft and LORA, is it possible to load the first checkpoint (knowing that the training is not finished) to make inference on it?Checkpoint-1 contains :adapter_config.jsonadapter_model.safetensorsoptimizer.pt  README.mdrng_state.pthscheduler.ptspecial_tokens_map.jsontokenizer_config.jsontokenizer.modeltrainer_state.jsontraining_args.binIf i try :model =AutoModelForCausalLM.from_pretrained(BASE_MODEL_PATH)ft_model = PeftModel.from_pretrained(model,checkpoint_path)Return :lib/python3.10/site-packages/safetensors/torch.py", line 308, in load_filewith safe_open(filename, framework=“pt”, device=device) as f:safetensors_rust.SafetensorError: Error while deserializing header: InvalidHeaderDeserializationThank’s