What is the text dataset format for fintune LLM?
i want to finetune a LLM on my own dataset that focus on specific subjecti have thousnds of text files about this subjectwhat is the required dataset format  for LLM?is it just text file?i have converted some of them to Q&A in json format like this{Q:“Question”A:“Answer”ID:"QuestionID "}
2023-06-07T11:38:33Z
Perhaps you can have a look here:huggingface.coHugging Face – The AI community building the future.We’re on a journey to advance and democratize artificial intelligence through open source and open science.And try to find the one that is the most similar to your case scenario.
2023-06-08T07:36:33Z
Thanks, got it