Skip to content

Conversation

@ibuziuk
Copy link
Contributor

@ibuziuk ibuziuk commented Mar 28, 2025

Related JIRA - https://issues.redhat.com/browse/CRW-8005

MCP server from @manusa is used https://github.com/manusa/kubernetes-mcp-server/

Screenshot 2025-04-15 at 17 17 25 Screenshot 2025-04-15 at 17 16 53
  • in order to try it out, you need a cluster with GPU nodes available (Developer Sandbox does not have it and 'Tools' / 'Agents' requests are timing out)
  • 'ollama' provider is used since 'openai' is not currently supported by Continue - Support of "Agents" for models with "openai" provider continuedev/continue#5044
  • llama3.1 with 70b will not work on clusters like Developer Sandbox, hence we can use only 8b
Screenshot 2025-04-07 at 13 40 12

TODO: make the same flow work with

Signed-off-by: Ilya Buziuk <[email protected]>
@github-actions
Copy link

Click here to review and test in web IDE: Contribute

@ibuziuk ibuziuk changed the title using Llama3.1-8b model Using Llama3.1-8b model with Kubernetes MCP Server Apr 8, 2025
@ibuziuk ibuziuk marked this pull request as ready for review April 15, 2025 14:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants