Upgrading of the base LLM model implemented on-premise and fine-tuned
Want to understand whether there is a way to upgrade the the base models version which has been fine-tuned with company specific data for an on-premise implementation.Since base models are also trained independently and new versions released, what would be the recommendation to upgrade the base model which is fine-tuned.Will we need to take the base-model and reapply all the trainings done as part of fine-tuning ?
2024-11-13T11:43:42Z
For example, if the model was trained using PEFT from the beginning, the computational cost of retraining would be low, but I don’t know if there is a way to make the difference between the already-trained normal model and the base model into LoRA.huggingface.coParameter-Efficient Fine-Tuning using 🤗 PEFTWe’re on a journey to advance and democratize artificial intelligence through open source and open science.philschmid.de – 23 Jan 24How to Fine-Tune LLMs in 2024 with Hugging FaceIn this blog post you will learn how to fine-tune LLMs using Hugging Face TRL, Transformers and Datasets in 2024. We will fine-tune a LLM on a text to SQL dataset.