Skip to content

Commit 0a2d794

Browse files
DOC: add FAQ LLM risk control (#716)
1 parent 3cf788e commit 0a2d794

File tree

2 files changed

+3
-14
lines changed

2 files changed

+3
-14
lines changed

doc/llm_risk_control.rst

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -10,4 +10,6 @@ Exciting news: we're currently working on extending MAPIE to control LLM systems
1010

1111
In the mean time, we propose a method presented in `Benchmarking LLMs via Uncertainty Quantification <https://arxiv.org/abs/2401.12794>`_, which reduces a commonsense reasoning task (CosmosQA dataset) to a classification problem, enabling the use of conformal predictions. The idea is to extract only the logits corresponding to the possible answers, and use a softmax so that the LLM can be used as a simple classifier.
1212

13-
The following `repository <https://github.com/vincentblot28/mapie_llm>`_ (not maintained by the MAPIE team) implements part of this paper for educational purposes.
13+
The following `repository <https://github.com/Valentin-Laurent/MAPIE-Educational-Content>`_ (not maintained by the MAPIE team) implements part of this paper for educational purposes in the ``MAPIE_for_cosmosqa`` notebook.
14+
15+
Additionally, we invite you to read our `blog article <https://medium.com/capgemini-invent-lab/quantifying-llms-uncertainty-with-conformal-predictions-567870e63e00>`_, where we dive deeper into the topic.

doc/mapie_llm.rst

Lines changed: 0 additions & 13 deletions
This file was deleted.

0 commit comments

Comments
 (0)