Trulens v2.4.1

What's Changed

• [Snowflake] web search agent example with snowflake ai obs by @sfc-gh-jreini in #2232
• Handle timestamps in get_events for Snowflake AI observability event table. by @sfc-gh-dkurokawa in #2226
• data agent with cortex example by @sfc-gh-jreini in #2236
• Update meta.yaml files for release 2.4.0 by @sfc-gh-dhuang in #2238
• OpenAI cost tracking w/ the new Responses API by @sfc-gh-dhuang in #2239
• Fix Cortex cost/usage tracking with latest REST API by @sfc-gh-dhuang in #2240
• [Feat] Update record viewer default expanded depth to 2 levels by @sfc-gh-nvytla in #2244
• [Snowflake] Virtual Run (batch eval run on data in existing table in Snowflake) by @sfc-gh-dhuang in #2224
• Fix get_records_and_feedbacks for AI Observability by @sfc-gh-dhuang in #2245
• [Snowflake] Add get_records and get_record_details APIs to AI Observability Run by @sfc-gh-dhuang in #2246
• Denoise trulens logs by @sfc-gh-dhuang in #2243
• Get Streamlit UI Record Viewer to work with AI Observability. by @sfc-gh-dkurokawa in #2233
• Create an "SPCS" mode for the dashboard that allows authentication through an OAuth token mounted into the docker container. by @sfc-gh-dkurokawa in #2241
• Add run_name to get_records_and_feedback. by @sfc-gh-dkurokawa in #2247
• Convert execute_query to return pd.DataFrame instead of List[Row]. by @sfc-gh-dkurokawa in #2251
• Refresh Snowflake connection when closed. by @sfc-gh-dkurokawa in #2250
• Fix - new Run API should take run_name when filtering records by @sfc-gh-dhuang in #2252
• [Feat] Add TS/TC/TQ judges by @sfc-gh-nvytla in #2256
• Avoid problematic transformers version requirement as there's an issue with its grouped optional dependencies. by @sfc-gh-dkurokawa in #2255

Full Changelog: trulens-2.4.0...trulens-2.4.1

trulens-2.4.0

New Features

• Tracing for LlamaIndex Workflows + Improved Async OpenAI support by @sfc-gh-jreini in #2212

• Add TruSession::compute_feedbacks_on_events function to compute feedbacks on arbitrary records and feedbacks. by @sfc-gh-dkurokawa in #2206

• trace compression by @sfc-gh-jreini in #2225

• Reranker span type type and inclusion of reranker span type in LlamaIndex auto-instrumentation @sfc-gh-jreini in #2222

• [Snowflake] Have AI observability work with get_records_and_feedback. by @sfc-gh-dkurokawa in #2223

• [Snowflake] Implementing client side custom metrics for Snowflake batch evaluation flow by @sfc-gh-dhuang in #2201

• [Snowflake] Update model costs in cortex_model_costs.json by @sfc-gh-jreini in #2228

Examples

• web search agent evals by @sfc-gh-jreini in #2209
• Update additional notebooks for OpenTelemetry by @sfc-gh-jreini in #2222

Bug Fixes

• Fix json structured output for cortex complete by @sfc-gh-dhuang in #2214 and #2217
• Use Feedback class instead of underlying function when running evals by @sfc-gh-jreini in #2219
• Restrict streamlit-aggrid to < 1.1.8 to fix. by @sfc-gh-dkurokawa in #2227

Full Changelog: trulens-2.3.1...trulens-2.4.0

trulens-2.3.1

What's Changed

• Langchain provider & Deepseek reasoning model support by @sfc-gh-jreini in #2191
• Allow for adding feedback (such as in human feedback). by @sfc-gh-dkurokawa in #2139
• Add Litellm structured outputs by @sfc-gh-chu in #2115

Bug Fixes

• Cleanup bedrock provider imports by @Labreo in #2202
• Explicitly turn off OTel tracing for examples not yet using OTel by @sfc-gh-jreini in #2205

New Contributors

• @Labreo made their first contribution in #2202

Full Changelog: trulens-2.3.0...trulens-2.3.1

Trulens v2.3.0

What's Changed

• add gpt-5 support, openai capabilities retry and caching, Context-Free-Grammar Support & Answer Relevance prompt fixes by @sfc-gh-jreini in #2189
• Allow main input specification for trace_with_run decorator (live tracing) by @sfc-gh-dhuang in #2182
• Enable OTEL tracing by default by @sfc-gh-dhuang in #2112

Examples

• Add Tutorial for Multimodal Evaluation with Gemini (Text, Audio, Video) by @sahusiddharth in #2185

Bug Fixes

• [Snowflake] Ensure OTel flushing + snowflake ingestion do not abort main app flow by @sfc-gh-dhuang in #2196
• Remove color from feedback pill expansion so that JSON entries in the dataframe can be displayed correctly. by @sfc-gh-dkurokawa in #2192
• Fix groundedness support for bedrock. by @sfc-gh-dkurokawa in #2193
• default str handler for llm provider by @sfc-gh-jreini in #2195
• Ensure all OTel spans to be exported to Snowflake before the process running the main thread terminates by @sfc-gh-dhuang in #2194

Full Changelog: trulens-2.2.4...trulens-2.3.0

Trulens v2.2.4

What's Changed

• Allow the use of your own lock for compute_now. by @sfc-gh-dkurokawa in #2184
• Bugfix: Clean up syntax, hanging vars, bugs in LangGraph quickstart nb by @sfc-gh-nvytla in #2186
• Batch insert events. by @sfc-gh-dkurokawa in #2183

Full Changelog: trulens-2.2.3...trulens-2.2.4

Trulens v2.2.3

What's Changed

• TruLens version 2.2.2. by @sfc-gh-dkurokawa in #2177
• feat: Added Google provider to enable evaluations with Gemini models by @sahusiddharth in #2153
• Use app versions instead of app ids when we can. by @sfc-gh-dkurokawa in #2179

New Contributors

• @sahusiddharth made their first contribution in #2153

Full Changelog: trulens-2.2.2...trulens-2.2.3

Trulens v2.2.2

What's Changed

• Used streamlit.Pages instead of the pages folder. by @sfc-gh-dkurokawa in #2176

Full Changelog: trulens-2.2.1...trulens-2.2.2

TruLens v2.2.1

New Features

• [Langgraph auto instrumentation] Improve instrumentation for Graph API by @sfc-gh-dhuang in #2172

Bug Fixes

• Record page UI updates by @sfc-gh-jreini in #2171

Full Changelog: trulens-2.2.0...trulens-2.2.1

TruLens v2.2.0

New Features

• Dropped "trajectory" prefix from agent evals by @sfc-gh-ajia in #2163
• Add context for inline evals by @sfc-gh-jreini in #2169

Bug Fixes

• Supply host to dashboard. by @sfc-gh-dkurokawa in #2165

Documentation and Examples

• update notebooks to new gpa-naming for agent evals by @sfc-gh-jreini in #2168

Full Changelog: trulens-2.1.4...trulens-2.2.0

TruLens v2.1.4

What's Changed

• add trulens-apps-langgraph to optional requirements by @sfc-gh-jreini in #2159
• Update Langgraph version requirements to ensure we instrument TaskFunction / _TaskFunction by @sfc-gh-dhuang in #2160
• [Snowflake] Live OTEL tracing with Snowflake Run by @sfc-gh-dhuang in #2158
• custom attribute instrumentation + langgraph instrumentation docs by @sfc-gh-jreini in #2161
• add openai gpt-oss example by @sfc-gh-jreini in #2162

Full Changelog: trulens-2.1.2...trulens-2.1.4