Skip to content

Commit 4e7a1eb

Browse files
Update the eval tutorial (#318)
* update the eval tutorial * correcting file name * some structural changes * add image * fix typos * Update index.toml Co-authored-by: Bilge Yücel <[email protected]> * resolving all comments * installation update --------- Co-authored-by: Bilge Yücel <[email protected]>
1 parent 87d45c2 commit 4e7a1eb

5 files changed

+18101
-4268
lines changed

README.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -42,7 +42,7 @@ Haystack 2.0
4242
| [Better Retrieval via Embedding Retrieval](./tutorials/06_Better_Retrieval_via_Embedding_Retrieval.ipynb) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/06_Better_Retrieval_via_Embedding_Retrieval.ipynb) | [Classifying Documents & Queries by Language](./tutorials/32_Classifying_Documents_and_Queries_by_Language.ipynb)| [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/32_Classifying_Documents_and_Queries_by_Language.ipynb)|
4343
| [[OUTDATED] RAG Generator](./tutorials/07_RAG_Generator.ipynb) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/07_RAG_Generator.ipynb) | [Creating a Hybrid Retrieval Pipeline](./tutorials/33_Hybrid_Retrieval.ipynb) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/33_Hybrid_Retrieval.ipynb) |
4444
| [Preprocessing](./tutorials/08_Preprocessing.ipynb) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/08_Preprocessing.ipynb) | [Build an Extractive QA Pipeline](./tutorials/34_Extractive_QA_Pipeline.ipynb) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/34_Extractive_QA_Pipeline.ipynb) |
45-
| [DPR Training](./tutorials/09_DPR_training.ipynb) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/09_DPR_training.ipynb) | [Model-Based Evaluation of RAG Pipelines](./tutorials/35_Model_Based_Evaluation_of_RAG_Pipelines.ipynb) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/35_Model_Based_Evaluation_of_RAG_Pipelines.ipynb)|
45+
| [DPR Training](./tutorials/09_DPR_training.ipynb) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/09_DPR_training.ipynb) | [Evaluating RAG Pipelines](./tutorials/35_Evaluating_RAG_Pipelines.ipynb) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/35_Evaluating_RAG_Pipelines.ipynb)|
4646
| [[OUTDATED] Knowledge Graph](./tutorials/10_Knowledge_Graph.ipynb) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/10_Knowledge_Graph.ipynb) | [Building Pipelines with Conditional Routing](./tutorials/36_Building_Fallbacks_with_Conditional_Routing.ipynb) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/36_Building_Fallbacks_with_Conditional_Routing.ipynb)|
4747
| [Pipelines](./tutorials/11_Pipelines.ipynb) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/11_Pipelines.ipynb) | [Simplifying Pipeline Inputs with Multiplexer](./tutorials/37_Simplifying_Pipeline_Inputs_with_Multiplexer.ipynb)| [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/37_Simplifying_Pipeline_Inputs_with_Multiplexer.ipynb)|
4848
| [[OUTDATED] Seq2SeqGenerator](./tutorials/12_LFQA.ipynb) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/12_LFQA.ipynb) | [Embedding Metadata for Improved Retrieval](./tutorials/39_Embedding_Metadata_for_Improved_Retrieval.ipynb) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/39_Embedding_Metadata_for_Improved_Retrieval.ipynb)|

index.toml

+4-4
Original file line numberDiff line numberDiff line change
@@ -377,12 +377,12 @@ haystack_2 = true
377377
dependencies = ["accelerate", "sentence-transformers", "datasets"]
378378

379379
[[tutorial]]
380-
title = "Model-Based Evaluation of RAG Pipelines"
381-
description = "Learn how to evaluate your RAG pipelines using some of the model-based evaluation frameworkes integerated into Haystack"
380+
title = "Evaluating RAG Pipelines"
381+
description = "Learn how to evaluate your RAG pipelines using statistical and model-based evaluation metrics"
382382
level = "intermediate"
383383
weight = 77
384-
notebook = "35_Model_Based_Evaluation_of_RAG_Pipelines.ipynb"
385-
aliases = []
384+
notebook = "35_Evaluating_RAG_Pipelines.ipynb"
385+
aliases = ["35_Model_Based_Evaluation_of_RAG_Pipelines"]
386386
completion_time = "15 min"
387387
created_at = 2024-02-12
388388
haystack_2 = true

0 commit comments

Comments
 (0)