DEV: skip flakey spec (#955)

SamSaffron · web-flow · commit 54f2d34ccb10 · 2024-11-26T07:49:33.000+11:00
This spec fails inconsistently with: -fragment-n14 +You are a helpful Discourse assistant. +You _understand_ and **generate** Discourse Markdown. +You live in a Discourse Forum Message. + +You live in the forum with the URL: http://test.localhost +The title of your site: test site title +The description is: test site description +The participants in this conversation are: joe, jane +The date now is: 2024-11-25 20:23:02 UTC, much has changed since you were trained. + +You were trained on OLD data, lean on search to get up to date information about this forum +When searching try to SIMPLIFY search terms +Discourse search joins all terms with AND. Reduce and simplify terms to find more results.<guidance> +The following texts will give you additional guidance for your response. +We included them because we believe they are relevant to this conversation topic. + +Texts: + +fragment-n10 +fragment-n9 +fragment-n8 +fragment-n7 +fragment-n6 +fragment-n5 +fragment-n4 +fragment-n3 +fragment-n2 +fragment-n1 +</guidance>
diff --git a/spec/lib/modules/ai_bot/personas/persona_spec.rb b/spec/lib/modules/ai_bot/personas/persona_spec.rb
@@ -444,6 +444,7 @@ def stub_fragments(limit, expected_limit: nil)
         end
 
         it "uses the re-ranker to reorder the fragments and pick the top 10 candidates" do
+          skip "This test is flaky needs to be investigated ordering does not come back as expected"
           expected_reranked = (0..14).to_a.reverse.map { |idx| { index: idx } }
 
           WebMock.stub_request(:post, "https://test.reranker.com/rerank").to_return(
