trulens-2.4.0
New Features
-
Tracing for LlamaIndex Workflows + Improved Async OpenAI support by @sfc-gh-jreini in #2212
-
Add
TruSession::compute_feedbacks_on_events
function to compute feedbacks on arbitrary records and feedbacks. by @sfc-gh-dkurokawa in #2206 -
trace compression by @sfc-gh-jreini in #2225
-
Reranker span type type and inclusion of reranker span type in LlamaIndex auto-instrumentation @sfc-gh-jreini in #2222
-
[Snowflake] Have AI observability work with
get_records_and_feedback
. by @sfc-gh-dkurokawa in #2223 -
[Snowflake] Implementing client side custom metrics for Snowflake batch evaluation flow by @sfc-gh-dhuang in #2201
-
[Snowflake] Update model costs in cortex_model_costs.json by @sfc-gh-jreini in #2228
Examples
- web search agent evals by @sfc-gh-jreini in #2209
- Update additional notebooks for OpenTelemetry by @sfc-gh-jreini in #2222
Bug Fixes
- Fix json structured output for cortex complete by @sfc-gh-dhuang in #2214 and #2217
- Use Feedback class instead of underlying function when running evals by @sfc-gh-jreini in #2219
- Restrict streamlit-aggrid to
< 1.1.8
to fix. by @sfc-gh-dkurokawa in #2227
Full Changelog: trulens-2.3.1...trulens-2.4.0