Jan returning different embeddings for the same text.

[jefferobertson]

When I request an embedding from the Jan server I sometimes get different results for the same request.
For example,
{
"encoding_format": "float",
"input": "Embeddings should return the same value for the same string",
"model": "Wayfarer-12B-IQ3_S.gguf"
}

[toutjavascript]

LLM (and all generative AI) works like that, with a part of random.
That is not an algorithm that can reproduce the same result.

If you want to get the same response, you need to provide the same seed on your request.

[jefferobertson]

I ran a cosine_similarity algorithm on the ones that were different, and the most distant result was 0.999542 (1.0 is perfect). This is more than close enough. I am curious, is there a way to set the seed, I don't see that on the embedding command, is it set elsewhere?