Stop response generation before completion

[jessetane]

MediaPipe Solution (you are using)

web/genai/inference

Programming language

javascript

Are you willing to contribute it

Yes

Describe the feature and the current behaviour/state

stopResponse, the complement to generateResponse

Will this change the current API? How?

Yes, by adding a stopResponse method

Who will benefit with this feature?

Everyone

Please specify the use cases for this feature

Time and power savings from being able to cancel output generation early. For example if a user spots a mistake in their query before the response is complete, they can quickly tweak their prompt and try again

Any Other info

Here is another issue I found requesting this feature but it seems to have been closed without explanation #5327

[kalyan2789g]

Hi @jessetane,

Thank you for your feature request. We are currently reviewing this with our developer team and will prioritize it based on our team's available resources and existing project timelines.

Thanks,
@kalyan2789g