Help, please! Seems fine tuning on LLM is not working
Hello everyone!I am relatively new to fine tuning and I am trying to fine tune this model “lmsys/vicuna-13b-v1.5-16k” with my dataset, which is a csv, made of just two columns and the most important one (“content”) is text taken from parsing PDF files (you can find something similar here:notebooks/examples/language_modeling.ipynb at main · huggingface/notebooks · GitHubin the “Preparing the dataset section”).In order to test if fine tuning really works, I foillowed this tutorial for beginners and I used 1500 PDFs of the thousands I have:Medium – 14 Aug 23Complete Guide to LLM Fine Tuning for BeginnersFine-tuning a model refers to the process of adapting a pre-trained, foundational model (such as Falcom or Llama) to perform a new task or…Reading time: 5 min readIt seems the fine tuning is running, but when it finishes and I try to ask a topic contained in one of the PDFs that I used, it starts hallucinanting! Even if the answer seems great and correct, it uses erroneous web links, names and events or facts!What is wrong? Is it my dataset? Is it the tutorial? Is it really “learning” something? How can I check it?I am testing this tutorial right now from Youtube:“okay, but I want GPT to perform 10x for my specific use case” - Here is howI hope it works!How did you menage to fine tune your model? Do you have any suggestion or tutorial or video, please? Any help would be so appreciated!Lastly, I hope my question is clear and useful for someone else too!Thank you so much in advance.Kind regards,Matteo
2024-01-16T06:09:10Z
Same problem here. Tried different hyperparameters include dataset size, epoch, lr, or everything with generation configuration tuning, results are broken. Literally I’m crying right now…
2024-04-05T07:24:51Z
Hy,@TeoR95can you please tell me how to read this medium article ,it’s showing need member subscription,i am unable to read it…
2024-04-05T08:37:18Z
Hello@TapanhaystekI am super sure it was free when I read it! Unfortunately, I am afraid it is only for members nowNo worry: there are plenty of fine-tuning tutorial on the Internet. However, for my project purposes, I found out that RAG is the best solution since, when I tried to ask specific information present in PDFs, fine-tuning kept on hallucinating…
2024-04-05T10:46:32Z
Actually,my project is to doing a chatbot using 1000 of pdfs and i use rag but the llms are hallucinated .Are you done the chatbot using 1000 of pdfs if yes then please share the idea and code if possible …if the code is private then please send in my mailmymail-tpati2001@gmail.comotherwise give me the github code please…