README.md

Evaluations

Here we provide full examples on how to use Haystack to evaluate systems build also with Haystack for different tasks and datasets.

Name	Dataset	Evaluation Metrics	📚 Article
RAG with parameter search	ARAGOG	ContextRelevance , Faithfulness, Semantic Answer Similarity	Benchmarking Haystack Pipelines for Optimal Performance
Baseline RAG vs HyDE using Harness	ARAGOG	ContextRelevance , Faithfulness, Semantic Answer Similarity	-
Extractive QA with parameter search	SQuAD	Answer Exact Match, DocumentMRR, DocumentMAP, DocumentRecall, Semantic Answer Similarity	-
Sentence-Window Retriever vs Baseline RAG	ARAGOG	ContextRelevance , Faithfulness, Semantic Answer Similarity	-