Fine-tuning don't work / bad results
Hello,I need your advice.I’m trying to fine-tune Llama2 7B (base Model) for a single task. My goal is the following: for a given text it should replace some words by others if they are present in the text, otherwise it should only return the text.However, when I make the inference, the task is not understood, the model simply repeats the instruction and returns a bit of nonsense.I used the huggingface trainer and formulated my prompt as ###INSTRUCTION:{} ###INPUT:{} ###RESPONSE:{}.I used the basic Lora parameters found in all the tutorials. I have about 2000 prompt data.Does anyone have any advice or explanation for my problem?Thanks for your help.
2024-03-14T01:45:52Z
Facing the same issue here.
2024-04-11T11:45:52Z
Same issue here.
2024-04-22T07:27:47Z
You can use fine-tune-ai dot com
2024-12-26T18:49:19Z
why does this thread have 1.3k views and no solutions? are we finetuning it badly?
2025-01-15T13:12:52Z
I am facing the same issue and find this site, maybe it could be beneficial for you.Top 7 Large Language Model Fine-tuning Mistakes to Avoid | Entry Point AI