Skip to content

Commit 6409d2f

Browse files
committed
fix: patch the benchmark schema file and improve Wasabi's README instructions
1 parent 2a8d374 commit 6409d2f

File tree

3 files changed

+6
-7
lines changed

3 files changed

+6
-7
lines changed
Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1 +1 @@
1-
{"artifact_id": "sosp24_wasabi", "artifact_dir": "sosp24_wasabi", "artifact_readme": "data/benchmark/sosp24_wasabi/wasabi/README.md", "artifact_url": "https://github.com/bastoica/wasabi/tree/sosp24-ae", "evaluator": "data/benchmark/sosp24_wasabi/wasabi/_agent_eval/main.py", "expected_score": 4, "docer_env": ""}
1+
{"artifact_id": "sosp24_wasabi", "artifact_dir": "sosp24_wasabi", "artifact_readme": "sosp24_wasabi/wasabi/README.md", "artifact_url": "https://github.com/bastoica/wasabi/tree/sosp24-ae", "evaluator": "sosp24_wasabi/wasabi/_agent_eval/main.py", "expected_score": 4, "docer_env": "bastoica/ae-agent-ubuntu24.04:latest"}

benchmarks/arteval_bench/data/benchmark/env_setup_examples.jsonl

Lines changed: 0 additions & 3 deletions
This file was deleted.

benchmarks/arteval_bench/data/benchmark/sosp24_wasabi/wasabi/README.md

Lines changed: 5 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -4,11 +4,13 @@ The testing component of WASABI triggers retry bugs by using a combination of st
44

55
## 2. Getting Started
66

7-
To get started, users should create a new directory structure, clone this repository, work on the `main` branch of the repository, configure and install dependencies, by following these steps:
7+
To get started, users should create a new directory structure, clone this repository, work on the `main` branch of the repository, configure and install dependencies.
8+
9+
Start by checking you have 'root' access to the system, and installing `sudo` using `apt-get install`. Then, go through the following three steps:
810

911
1. If not already in place, create a the appropriate directory structure:
1012

11-
Note that your current working directory where the `README.md` is located id `~/sosp24_wasabi/benchmarks/wasabi`
13+
Note that your current working directory where the `README.md` is located id `~/sosp24_wasabi/wasabi`
1214
```bash
1315
mkdir -p ~/sosp24_wasabi/benchmarks
1416
cd ~/sosp24_wasabi/
@@ -29,7 +31,7 @@ The working directory structure should look similar to the one below:
2931
├── src/
3032
└── utils/
3133
```
32-
The `wasabi` directory contains the codebase of WASABI, while the `bugfinding` directory is where users can add applications that they want to use WASABI to find retry bugs.
34+
The `wasabi` directory contains the codebase of WASABI, while the `benchmarks` directory is where users can add applications that they want to use WASABI to find retry bugs.
3335

3436
2. Set up the `WASABI_ROOT_DIR` environment variable:
3537
```

0 commit comments

Comments
 (0)