Skip to content

Commit be044b0

Browse files
committed
Fix MCP install: drop shadowing .mcp.json, use shorter add command
The committed project-scope .mcp.json with bare "eval-mcp" command shadowed user-scope installs (Claude Code scope precedence: local > project > user) and failed to connect since the binary isn't on PATH after the documented uvx-based install. Removing it lets the README one-liner work everywhere. Switch that one-liner to the cleaner positional form — same result, less shell-escaping, stdio default.
1 parent 0cca841 commit be044b0

5 files changed

Lines changed: 9 additions & 10 deletions

File tree

.gitignore

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -117,5 +117,11 @@ terraform.tfvars
117117
.tools/
118118
.claude/
119119

120+
# Project-scope MCP config — must not be committed: it shadows users' user-scope
121+
# eval-mcp install for anyone who cd's into this repo (Claude Code scope
122+
# precedence: local > project > user). Contributors who want to dogfood from
123+
# source can create one locally; see docs/DEVELOPMENT.md.
124+
.mcp.json
125+
120126
# Local eval log artifacts (synced via S3)
121127
logs/

.mcp.json

Lines changed: 0 additions & 7 deletions
This file was deleted.

INSTALL.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -24,7 +24,7 @@ If multiple, ask the user which.
2424

2525
Run the one-command install for that IDE:
2626

27-
- **Claude Code**: `claude mcp add-json eval '{"type":"stdio","command":"uvx","args":["--from","llm-evaluation-system","eval-mcp"]}' --scope user`
27+
- **Claude Code**: `claude mcp add eval -s user -- uvx --from llm-evaluation-system eval-mcp`
2828
- **Cursor**: open `cursor://anysphere.cursor-deeplink/mcp/install?name=eval&config=eyJjb21tYW5kIjoidXZ4IiwiYXJncyI6WyItLWZyb20iLCJsbG0tZXZhbHVhdGlvbi1zeXN0ZW0iLCJldmFsLW1jcCJdfQ==` (or edit `~/.cursor/mcp.json`)
2929
- **VS Code**: `code --add-mcp '{"name":"eval","command":"uvx","args":["--from","llm-evaluation-system","eval-mcp"]}'`
3030
- **Kiro**: merge into `~/.kiro/settings/mcp.json` under `mcpServers.eval` — same JSON shape as Cursor. Back up first, atomic write.

README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -26,7 +26,7 @@ Pick your IDE and paste / click.
2626

2727
**Claude Code** — one CLI command:
2828
```bash
29-
claude mcp add-json eval '{"type":"stdio","command":"uvx","args":["--from","llm-evaluation-system","eval-mcp"]}' --scope user
29+
claude mcp add eval -s user -- uvx --from llm-evaluation-system eval-mcp
3030
```
3131

3232
**Cursor** — one-click deeplink: [Install eval-mcp in Cursor](cursor://anysphere.cursor-deeplink/mcp/install?name=eval&config=eyJjb21tYW5kIjoidXZ4IiwiYXJncyI6WyItLWZyb20iLCJsbG0tZXZhbHVhdGlvbi1zeXN0ZW0iLCJldmFsLW1jcCJdfQ==)

eval_mcp/INSTALL.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -24,7 +24,7 @@ If multiple, ask the user which.
2424

2525
Run the one-command install for that IDE:
2626

27-
- **Claude Code**: `claude mcp add-json eval '{"type":"stdio","command":"uvx","args":["--from","llm-evaluation-system","eval-mcp"]}' --scope user`
27+
- **Claude Code**: `claude mcp add eval -s user -- uvx --from llm-evaluation-system eval-mcp`
2828
- **Cursor**: open `cursor://anysphere.cursor-deeplink/mcp/install?name=eval&config=eyJjb21tYW5kIjoidXZ4IiwiYXJncyI6WyItLWZyb20iLCJsbG0tZXZhbHVhdGlvbi1zeXN0ZW0iLCJldmFsLW1jcCJdfQ==` (or edit `~/.cursor/mcp.json`)
2929
- **VS Code**: `code --add-mcp '{"name":"eval","command":"uvx","args":["--from","llm-evaluation-system","eval-mcp"]}'`
3030
- **Kiro**: merge into `~/.kiro/settings/mcp.json` under `mcpServers.eval` — same JSON shape as Cursor. Back up first, atomic write.

0 commit comments

Comments
 (0)