Skip to content

Conversation

conmelj
Copy link
Contributor

@conmelj conmelj commented Aug 27, 2025

What does this PR do? What is the motivation?

Update documentation to properly describe what is passed into DD_LLMOBS_EVALUATORS_SAMPLING_RULES (objects not list of arrays)

Merge instructions

Merge readiness:

  • Ready for merge

Additional notes

Update documentation to properly describe what is passed into DD_LLMOBS_EVALUATORS_SAMPLING_RULES (objects not list of arrays)
@conmelj conmelj requested a review from a team as a code owner August 27, 2025 15:07
@michaelcretzman michaelcretzman self-assigned this Aug 27, 2025
michaelcretzman and others added 3 commits August 27, 2025 14:56
…n sampling

The correct env variable for configuring evaluation sampling is DD_LLMOBS_EVALUATOR_SAMPLING_RULES and not DD_LLMOBS_EVALUATORS_SAMPLING_RULES.
@conmelj
Copy link
Contributor Author

conmelj commented Aug 27, 2025

@michaelcretzman I have updated this PR to include some additional changes. The docs are referencing an incorrect env variable name for configuring sampling of evaluations.

incorrect - DD_LLMOBS_EVALUATORS_SAMPLING_RULES
correct - DD_LLMOBS_EVALUATOR_SAMPLING_RULES

Thankfully, the notebooks in this repository use the correctly named variable.

@michaelcretzman michaelcretzman added the under_review Sent to someone outside of the docs team for review. label Aug 27, 2025
@michaelcretzman
Copy link
Contributor

Asked Eng Manager to review

@hestonhoffman hestonhoffman removed the under_review Sent to someone outside of the docs team for review. label Aug 28, 2025
@michaelcretzman michaelcretzman merged commit 6e71151 into DataDog:master Aug 28, 2025
20 checks passed
brett0000FF pushed a commit that referenced this pull request Aug 29, 2025
…d into DD_LLMOBS_EVALUATORS_SAMPLING_RULES (#31313)

* Update ragas_evaluations.md

Update documentation to properly describe what is passed into DD_LLMOBS_EVALUATORS_SAMPLING_RULES (objects not list of arrays)

* Update ragas_evaluations.md to use correct env variable for evaluation sampling

The correct env variable for configuring evaluation sampling is DD_LLMOBS_EVALUATOR_SAMPLING_RULES and not DD_LLMOBS_EVALUATORS_SAMPLING_RULES.

---------

Co-authored-by: Michael Cretzman <58786311+michaelcretzman@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants