Finetuning llm model using Trainer and reusing it
Hi , I am new to llm finetuning . Recently I finetuned a llama-7b model on custom data for question answering .After training I saved the model using“model.save_pretrained(OUTPUT_DIR)”command . But in the OUTPUT_DIR I got two filesadapter_config.jsonand“adapter_model.bin”file . I dont know how to use it to reload the model . Also finding difficulty in further using the model for text generation . Can anyone help here ?
2023-07-27T06:17:20Z
Hello, It will be a great help if you will provide your notebook
2023-07-27T06:52:54Z
colab.research.google.comGoogle Colaboratory
2023-08-17T12:30:45Z
Can someone pls help here? I am getting the same dilema.