Skip to content

Latest commit

 

History

History
42 lines (34 loc) · 1.88 KB

File metadata and controls

42 lines (34 loc) · 1.88 KB

Internal NemoCheck Plugin

Prerequisites: Nemo-check server

  • Refer to orignal repo for full instructions

  • Instructions adpated for mcpgateway kind cluster to work with an llm proxy routing to some open ai compatable backend below

     docker pull quay.io/rh-ee-mmisiura/nemo-guardrails:guardrails_checks_with_tools_o1_v1
     kind load docker-image quay.io/rh-ee-mmisiura/nemo-guardrails:guardrails_checks_with_tools_o1_v1 --name mcp-gateway
     cd plugins-adapter/plugins/examples/nemocheck/k8deploy
     kubectl apply -f config-tools.yaml
     kubectl apply -f server.yaml
    

Installation

  1. Find url of nemo-check-server service. E.g., from svc in server.yaml

  2. Update ${project_root}/resources/config/config.yaml. Add the blob below, merge if other plugins or plugin_dirs already exists. Sample file here

    # plugins/config.yaml - Main plugin configuration file
    plugins:
      - name: "NemoCheckv2"
        kind: "plugins.examples.nemocheckinternal.plugin.NemoCheckv2"
        description: "Adapter for nemo check server"
        version: "0.1.0"        
        hooks: ["tool_pre_invoke", "tool_post_invoke"]
        mode: "enforce"  # enforce | permissive | disabled
        config:
          checkserver_url: "http://nemo-guardrails-service:8000/v1/guardrail/checks"    
    # Plugin directories to scan
    plugin_dirs:
      - "plugins/examples/nemocheckinternal"    # Nemo Check Server plugins
  3. In config.yaml ensure key plugins.config.checkserver_url points to the correct service

  4. Start plugin adapter

Test

  1. Open mcp-inspector to the mcp-gateway
  2. Try running a tool configured/not configured in nemo check config allow list in configmap E.g.