-
Notifications
You must be signed in to change notification settings - Fork 1
Home
Kevin Etchells edited this page Sep 25, 2025
·
1 revision
Gov AI Chat is a chat interface specifically designed for interacting with multiple MCP servers and tools.
- Frontend: An Astro app, using SSR and web components for client-side interactivity
- Database: A Postgres Docker image
Currently, sticky sessions need to be enabled on the load balancer (so a user always uses the same instance for their session). This is because when a message is sent, a combination of a POST request is used, followed by a SSE connection for the streaming. These need to happen on the same instance.
If enabling sticky sessions isn't possible, a couple of other options exist:
- Add a separate NodeJs server (as part of the frontend container) so web-sockets can be used. This would allow combining the POST request and the SSE connection into a single web-socket connection.
- Use Amazon SQS or a similar solution for the streaming