Replacements / rewrites are behaving oddly #17
Description
Maybe I'm just used to the new wave of GPT-4ish models, but I've noticed that with just about any request, the responses the model (one of the Geminis?) returns are highly ignorant of the insertion point. I suspect that whatever model is being used here isn't operating as well as the system did when being tested. Just a hunch. I haven't saved the results from my more elaborate usage, but here is just the first thing that I ran to try to get an example of what I'm talking about.
Story: {In between the two mountains ____ nasty who sold the heart of the mountain to the cowherd.}
The phrase to be rewritten that fills in the blank: {lived something}
The phrase rewritten to be more descriptive:
Generate 8 responses. Each response must start with: { and end with: }
index.ts:134 🚀 model results: { and there lived an elderly hermit}
{ and a hideous sorcerer named Maldred}
{ and a strange creature with emerald scales}
{ and a mysterious woman known as the Lady of the Lake}
{ and lived a powerful wizard who had mastered the dark arts}
{ and a young woman who possessed the gift of foresight}
{ and a cunning thief who stole from the rich and gave to the poor}
{ and a wise old tree that had witnessed centuries of history}
Notice how none of the results are grammatical? This is the norm.
The UI is so incredibly impressive though and the surreality of the results has been fun to play with.