SemanticSimilarity API (with_column) error

[mforsterqvest]

Hello I'm attempting to use SemanticSimilarity from the tutorial and I get the following error:

ValidationError: 1 validation error for SemanticSimilarity with_column field required (type=value_error.missing)

I'm currently invoking the API as the following:

SemanticSimilarity( display_name="Response Similarity"). \ on(["target_response", "new_response"])

Has there been any updates to the API?

[elenasamuylova]

Hi @mforsterqvest , could you specify which tutorial are you refering to?

[mforsterqvest]

Hello @elenasamuylova the tutorial link is https://www.evidentlyai.com/blog/llm-regression-testing-tutorial.

[elenasamuylova]

Hi @mforsterqvest , thanks for flagging! There has indeed been a change in the API that was not updated in all examples.

Check the correct code here: https://github.com/evidentlyai/community-examples/blob/main/tutorials/How_to_run_regression_testing_for_LLMs.ipynb