add language classification tutorial (deepset-ai#281)

Tilde Thurium · TuanaCelik · web-flow · commit adec33bac7ac · 2024-02-06T19:15:04.000+01:00
* add language classification tutorial

* fixing review comments

* Update README.md

* Update run_tutorials.yml

* make intermediate

---------

Co-authored-by: Tuana Celik &lt;tuana.celik@deepset.ai&gt;
diff --git a/.github/workflows/run_tutorials.yml b/.github/workflows/run_tutorials.yml
@@ -72,6 +72,7 @@ jobs:
               "tutorials/29_Serializing_Pipelines.ipynb"
               "tutorials/30_File_Type_Preprocessing_Index_Pipeline.ipynb"
               "tutorials/31_Metadata_Filtering.ipynb"
+              "tutorials/32_Classifying_Documents_and_Queries_by_Language.ipynb"
           )
           for changed_file in ${{ steps.files.outputs.all_changed_files }}; do
             if [[ $changed_file == *".ipynb" ]]; then
diff --git a/README.md b/README.md
@@ -41,7 +41,7 @@ Haystack 2.0
 | [Build a Scalable Question Answering System](./tutorials/03_Scalable_QA_System.ipynb)                     | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/03_Scalable_QA_System.ipynb)                                      | [Serializing Pipelines](./tutorials/29_Serializing_Pipelines.ipynb)                                              | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/29_Serializing_Pipelines.ipynb)                  |
 | [FAQ Style QA](./tutorials/04_FAQ_style_QA.ipynb)                                                         | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/04_FAQ_style_QA.ipynb)                                            | [Preprocessing Different File Types](./tutorials/30_File_Type_Preprocessing_Index_Pipeline.ipynb)                | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/30_File_Type_Preprocessing_Index_Pipeline.ipynb) |
 | [Evaluation](./tutorials/05_Evaluation.ipynb)                                                             | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/05_Evaluation.ipynb)                                              | [Metadata Filtering](./tutorials/31_Metadata_Filtering.ipynb)                                                    | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/31_Metadata_Filtering.ipynb)                     |
-| [Better Retrieval via Embedding Retrieval](./tutorials/06_Better_Retrieval_via_Embedding_Retrieval.ipynb) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/06_Better_Retrieval_via_Embedding_Retrieval.ipynb)                |                                                                                                                  |                                                                                                                                                                                                                          |
+| [Better Retrieval via Embedding Retrieval](./tutorials/06_Better_Retrieval_via_Embedding_Retrieval.ipynb) | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/06_Better_Retrieval_via_Embedding_Retrieval.ipynb)                | [Classifying Documents & Queries by Language](./tutorials/32_Classifying_Documents_and_Queries_by_Language.ipynb)| [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/32_Classifying_Documents_and_Queries_by_Language.ipynb)|
 | [[OUTDATED] RAG Generator](./tutorials/07_RAG_Generator.ipynb)                                            | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/07_RAG_Generator.ipynb)                                           |                                                                                                                  |                                                                                                                                                                                                                          |
 | [Preprocessing](./tutorials/08_Preprocessing.ipynb)                                                       | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/08_Preprocessing.ipynb)                                           |                                                                                                                  |                                                                                                                                                                                                                          |
 | [DPR Training](./tutorials/09_DPR_training.ipynb)                                                         | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/09_DPR_training.ipynb)                                            |                                                                                                                  |                                                                                                                                                                                                                          |
@@ -62,4 +62,3 @@ Haystack 2.0
 | [Building a Conversational Chat App](./tutorials/24_Building_Chat_App.ipynb)                              | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/24_Building_Chat_App.ipynb)                                       |                                                                                                                  |                                                                                                                                                                                                                          |
 | [Customizing Agent to Chat with Your Documents](./tutorials/25_Customizing_Agent.ipynb)                   | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/25_Customizing_Agent.ipynb)                                       |                                                                                                                  |                                                                                                                                                                                                                          |
 | [Creating a Hybrid Retrieval Pipeline](./tutorials/26_Hybrid_Retrieval.ipynb)                             | [![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/deepset-ai/haystack-tutorials/blob/main/tutorials/26_Hybrid_Retrieval.ipynb)                                        |                                                                                                                  |                                                                                                                                                                                                                          |
-
diff --git a/index.toml b/index.toml
@@ -318,4 +318,15 @@ notebook = "31_Metadata_Filtering.ipynb"
 aliases = []
 completion_time = "5 min"
 created_at = 2024-01-30
+haystack_2 = true
+
+[[tutorial]]
+title = "Classifying Documents & Queries by Language"
+description = "Learn how to classify documents and route queries by language, for both indexing and RAG pipelines"
+level = "intermediate"
+weight = 75
+notebook = "32_Classifying_Documents_and_Queries_by_Language.ipynb"
+aliases = []
+completion_time = "15 min"
+created_at = 2024-02-06
 haystack_2 = true
diff --git a/tutorials/32_Classifying_Documents_and_Queries_by_Language.ipynb b/tutorials/32_Classifying_Documents_and_Queries_by_Language.ipynb

Original file line number	Diff line number	Diff line change
`@@ -72,6 +72,7 @@ jobs:`
`72`	`72`	`"tutorials/29_Serializing_Pipelines.ipynb"`
`73`	`73`	`"tutorials/30_File_Type_Preprocessing_Index_Pipeline.ipynb"`
`74`	`74`	`"tutorials/31_Metadata_Filtering.ipynb"`
	`75`	`+ "tutorials/32_Classifying_Documents_and_Queries_by_Language.ipynb"`
`75`	`76`	`)`
`76`	`77`	`for changed_file in ${{ steps.files.outputs.all_changed_files }}; do`
`77`	`78`	`if [[ $changed_file == *".ipynb" ]]; then`