Is TruLen have an Build in eval functions that can be used with Gemini AI model or only it used with OpenAI

[Farahala]

Is TruLen have an Build in eval functions that can be used with Gemini AI model or only it used with OpenAI

[dosubot[bot]]

Hi @Farahala! I'm Dosu and I’m helping the trulens team.

TruLens has built-in evaluation (feedback) functions for several providers, including OpenAI, Huggingface, AWS Bedrock (Amazon, Anthropic, Cohere, AI21, Meta, Mistral), and LangChain (which can wrap many LLMs depending on integration). However, there is no built-in support for Google's Gemini AI models—no provider, feedback function, or code reference for Gemini exists in the current codebase or documentation. The evaluation infrastructure is model-agnostic and can work with any provider that implements the required interface, but out-of-the-box, Gemini is not supported. If you want to use Gemini, you would need to implement a custom provider, similar to how OpenAI and others are integrated.
Reference: Provider and Feedback architecture

To reply, just mention @dosu.

---

^{How did I do? Good | Irrelevant | Incorrect | Verbose | Hallucination | Report 🐛 | Other}    

[sfc-gh-jreini]

Wrong @dosubot

TruLens supports many LLM providers for feedback functions including LiteLLM, Bedrock, and Google.

You can find examples on how to use the Google provider here: https://github.com/truera/trulens/tree/main/examples/expositional/models/google

[Farahala]

I tried this but iam always getting error ```
line 83, in
.on(Select.RecordCalls.retrieve.rets.collect())
~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Python\Python313\site-packages\trulens\core\feedback\feedback.py", line 632, in on
raise ValueError(
f"OTEL mode only supports dictionary selectors, not {type(selectors)}!"
)

[sfc-gh-jreini]

Hi @Farahala - sorry about this.

Last week we turned on OpenTelemetry by default, but this example does not yet use OpenTelemetry.

To try this example as is, you can simply turn off OTEL tracing by setting the environment variable:

os.environ["TRULENS_OTEL_TRACING"] = "0"

Alternatively, the google provider could be used in the standard QuickStart by just changing the provider line to:

from trulens.providers.google import Google

provider = Google()

[Farahala]

Hello , another question is the dashboard can be self hosted ? @sfc-gh-jreini