Evaluating golden prompts #189
Description
Is there advice on reliably triggering the model to display a widget? I'm trying establish a golden prompt set according to the directions on https://developers.openai.com/apps-sdk/guides/optimize-metadata
I can make my widget appear by typing its name into the text box, or by clicking the '+' button and adding it. The correct tool is called, with the correct arguments, and the widget renders correctly.
But I can rarely make it show just by describing what I want to do, e.g. "I want to book a trip". My resource and tool metadata are explicit that I support those intents (e.g. "use this tool to book a trip"), but nothing happens.
When I test my app with a tool like MCPJam's "Test Cases", it works. Just not with ChatGPT directly.
Just wonder if anyone else has this problem, or if I'm doing something wrong somewhere?