How does RAGAS work?
Hello everybody,I take a look in theRAGAS libraryand my question is,how do they handle the response of the evaluation language models and based on them, how do they calculate the metrics?If I implement RAGAS by myself, I prompt the (evaluation) language model like Llama-2. In the next step I extract the results with the help of regular expression. As last step I calculate the values that RAGAS describe in their paper.But, I take a look in theRAGAS libraryand I can’t find a process to handle the responses.How do they do that?Best regardsChristian
2024-03-04T12:31:01Z
Hi,You can see more detailed explanations of how the metrics are calculated ontheir website.