Seeing duplicate demos

[MattCremeens]

I noticed in a query I was optimizing, when using using num_promos = 3, I was getting duplicate demonstrations. I am not sure if that's because there are duplicates in the selection pool or something else. As a quick fix, I did change

sorted_scores = sorted(sim_scores, reverse=True)

to

sorted_scores = list(set(sorted(sim_scores, reverse=True)))

in get_k_promos in LLM_R2.py.

This worked, but I'm guessing there is a better fix. Of course I'm operating under the assumption that you didn't intend to produce duplicate demos inside the prompt.

Please advise. Again, I am continually thankful for your work and responses to my questions.