[feature] Streaming Functionality?

[ccocks]

I would really appreciate it if there was a way to enable streaming (stream: True?) . That would be helpful for a lot of free AI projects. I am willing to work on it.

[cicerorph]

It's probably impossible to implement something like it, only if it was a reporter that you needed to check every second, and it couldn't have multiple requests at once.

[ccocks]

Hmm... I'm not sure what you mean @cicerorph, Most AI providers do provide a streamable APIs, so what’s preventing streaming from being implemented here?

[cicerorph]

Hmm... I'm not sure what you mean @cicerorph, Most AI providers do provide a streamable APIs, so what’s preventing streaming from being implemented here?

I'm saying that, I'm not adding streaming if the actual extension doesn't support it.

[Mistium]

It's probably impossible to implement something like it, only if it was a reporter that you needed to check every second, and it couldn't have multiple requests at once.

it’s possible

[MiloDev123]

I would really appreciate it if there was a way to enable streaming (stream: True?) . That would be helpful for a lot of free AI projects. I am willing to work on it.

Might implement that function in my API soon, will try to add something for the extension to support streaming too. Thanks for your suggestion, greatly appreciated!

[ccocks]

yw

... in my API soon ...

@MiloDev123, What do you mean by soon? I don't mean to rush, because I have alternative API's but I'd just like an approx date.

[MiloDev123]

yw

... in my API soon ...

@MiloDev123, What do you mean by soon? I don't mean to rush, because I have alternative API's but I'd just like an approx date.

I just finished coding the streaming feature, its working on private endpoint so ig it will work in this week or sooner.

[ccocks]

Also, is there something wrong with the API? It doesn't seem to be working...

[MiloDev123]

Also, is there something wrong with the API? It doesn't seem to be working...

Works fine for me, also streaming works too since 24th December. This is the api: https://api.penguinai
tech/v1

[ccocks]

Oops... I'm still on https://penguinai.milosantos.com/

[ccocks]

@MiloDev123, and it's down again:
Error 1033 Ray ID: 90d60b859a693961 • 2025-02-05 21:38:01 UTC
Cloudflare Tunnel error

I have other alternatives for gemini and some openai models, but many of the models I wanted aren't there so I have to depend on PenguinAI. Also any examples/quickstarts for streaming (lol, I asked for it and never implemented it)?

[MiloDev123]

@MiloDev123, and it's down again:
Error 1033 Ray ID: 90d60b859a693961 • 2025-02-05 21:38:01 UTC
Cloudflare Tunnel error

I have other alternatives for gemini and some openai models, but many of the models I wanted aren't there so I have to depend on PenguinAI. Also any examples/quickstarts for streaming (lol, I asked for it and never implemented it)?

Its up? Last downtime/reconection was 7 days ago

[MiloDev123]

Also any examples/quickstarts for streaming (lol, I asked for it and never implemented it)?

Ill try to send an example when I have time