Discussions

• 1 You must be logged in to vote

  💡

  Idea: long-horizon tension crash tests as an eval dimension for DeepEval

  onestardao started Feb 6, 2026 in Ideas

  

  

  0
• 1 You must be logged in to vote

  🙏

  getting cost of running deepeval with langfuse

  jg435 asked Apr 28, 2025 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  💬

  None returns when running gemini model in async mode

  awaiting clarification

  gyi123 started May 13, 2025 in General

  

  

  1
• 1 You must be logged in to vote

  🙏

  Deepeval not working properly for large context (Retrival).

  awaiting clarification

  gunasekarperiyasamy-wk asked Jul 9, 2025 in Q&A · Unanswered

  

  

  1
• 2 You must be logged in to vote

  🙏

  Issue Title: Blocked Access to api.ipify.org - Need Alternative Solutions

  awaiting clarification

  joshiji789 asked Jul 17, 2025 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Contextual Precision 0% - Contextual Relevancy 100%

  awaiting clarification

  thedengerzone asked Jul 23, 2025 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Golden's class: context field purpose

  awaiting clarification

  myanez007 asked Sep 22, 2025 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Why G-Eval isn't used to generate the squad score ?

  help wanted Extra attention is needed

  zoulou00 asked Sep 26, 2025 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Synthetic testset generation in another language

  help wanted Extra attention is needed

  karldergr0sse asked Oct 6, 2025 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  [question] Custom Model Name + No Actual run + Annotation

  awaiting clarification

  kuatroka asked Oct 20, 2025 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Making the python debugger work in VS Code with deepeval test run

  invalid This doesn't seem right

  oliverbock asked Oct 21, 2025 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  What is the best practice to evaluate negative test case?

  awaiting clarification

  jianfengzhang-maersk asked Oct 28, 2025 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  💬

  a.py in repo

  dchou1618 started Jan 6, 2026 in General

  

  

  1
• 2 You must be logged in to vote

  🙏

  How to use DeepEval in Rust LLM application

  hongbo-miao asked Aug 7, 2025 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Traces are not getting uploaded to the dasboard

  Vijay-K7-Plivo asked Aug 8, 2025 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Is component-level evaluation expected to be supported locally?

  antonpibm asked Aug 19, 2025 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  DEEPEVAL_TELEMETRY_OPT_OUT="YES" is not working

  shanmukh-sai2003 asked Feb 20, 2025 in Q&A · Unanswered

  

  

  4
• 2 You must be logged in to vote

  💬

  Why isn't LiteLLM supported as a model?

  antonpibm started May 24, 2025 in General

  

  

  

  

  3
• 1 You must be logged in to vote

  🙏

  Inconsistent scoring using a custom AnswerRelevancyTemplate

  MRLab12 asked Jun 9, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  How to disable console?

  saipavankumar9 started Apr 2, 2025 in General

  

  

  

  

  3
• 1 You must be logged in to vote

  🙏

  How to support Rest API calling in custom wrapper asynchronous model invoke function.

  sriramraja-krish asked May 7, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Contextual Precision Metric behavior

  iosuAbal asked Apr 30, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Take forever to evaluate one case

  lvying603-kjm asked Apr 29, 2025 in Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  🙏

  Reproducibility

  ShiraVH asked Oct 23, 2024 in Q&A · Unanswered

  

  

  

  

  3
• 1 You must be logged in to vote

  🙏

  Scorer vs metrics/test cases

  mausch asked Dec 10, 2024 in Q&A · Answered

  

  

  3