Streaming for short text

[ledgerstand-ops]

What happened?

Most times the streaming for short text still takes 4-8s before audio plays. this is the same time as a normal generation.

Can we have streaming with 1s or 2s buffer time.
My CPU is ryzen 3900
running with normal model and fp16 model

Steps to reproduce

1. step one...
2. step two...

What OS are you seeing the problem on?

No response

Package version

No response

Relevant log output

[RavSinghChandan]

Seeing the same thing — streaming short text still waits the full generation time (4-8s) before any audio plays, so it doesn't feel like streaming. I use kokoro for TTS and this is noticeable.

Happy to look into yielding the first chunk earlier so playback can start sooner. Should I open a PR to explore it?