Skip to content

fix(llm): fix vertex streaming#447

Merged
ionmincu merged 1 commit intomainfrom
fix/char_vertex_streaming
Jan 28, 2026
Merged

fix(llm): fix vertex streaming#447
ionmincu merged 1 commit intomainfrom
fix/char_vertex_streaming

Conversation

@ionmincu
Copy link
Copy Markdown
Collaborator

@ionmincu ionmincu commented Jan 21, 2026

Description

ChatVertex was simulating streaming because of a bug in llm gateway. We simulated stream with a simple invoke in the past. This Pr removes the fake stream and astream to allow the base to use actuall streaming.

@ionmincu ionmincu force-pushed the fix/char_vertex_streaming branch 3 times, most recently from 11afaea to b0c16f2 Compare January 28, 2026 09:28
@ionmincu ionmincu force-pushed the fix/char_vertex_streaming branch from b0c16f2 to cc98864 Compare January 28, 2026 09:29
@ionmincu ionmincu marked this pull request as ready for review January 28, 2026 09:34
@ionmincu ionmincu requested a review from cristipufu January 28, 2026 09:34
@ionmincu ionmincu merged commit c7801e1 into main Jan 28, 2026
39 checks passed
@ionmincu ionmincu deleted the fix/char_vertex_streaming branch January 28, 2026 10:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants