I fine-tuned the falcon-7b, why is my result such a let down?
Hello, basically I am trying to improve the generated horror stories, creepy pastas to be exact.I was following a tutorial where someone fine-tuned the falcon-7b in order to create better mid journey prompts, I figured that it is not a distant use-case to mine so it would work.Well it works, kinda.The model gets usually stuck on one sentence and repeats it over and over, even when I penalize heavy it provides some part that is ok, but after some tokens it hangs up on one sentence.Also the stories don’t seem to end.My problem is that I don’t know where the fault happened since there are many possible points I believe.I think my dataset is good, I found it online and it provides 3200 creepy pasta stories with a name, rating, category, estimated reading time and tags.I removed all features but the story and the estimated reading time.Thisis the colab document that I rewrote for my use case, I did not change anything but the dataset and the training prompt.I would appreciate a push in the right direction, whether my use-case is even possible and what my next step could be.
2023-08-15T22:36:40Z
Are you able to use this training data to fine-tune a larger model, like a 13b model or falcon’s 40b version? How does that work?The falcon 7b’s instruct page says if you want to fine-tune the model, you should fine-tune the normal version and not instruct. Maybe this is related.
2023-08-18T09:07:09Z
Thank you, I will look into it, I hadn’t had much time as of last week