Skip to content

Commit 59e391b

Browse files
amithkkanerli
authored andcommitted
Add documentation for continueAfterFailure
1 parent fed0e33 commit 59e391b

1 file changed

Lines changed: 22 additions & 1 deletion

File tree

docs/testing/test-configuration.mdx

Lines changed: 22 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -61,7 +61,28 @@ export default {
6161

6262
Magnitude checks if `webServer.url` is already reachable. If so and `reuseExistingServer` is `true`, the command is skipped. The server process is killed automatically once the test run completes.
6363

64-
## Test URL resolution
64+
## Test failure behaviour
65+
66+
The default behaviour for failed tests is to terminate execution after the first failed test. To change this and allow other tests to run regardless of failed tests, you can either
67+
68+
- Run magnitude with the `--no-fail-fast` CLI flag
69+
- Add `continueAfterFailure: true` to your `magnitude.config.ts`
70+
71+
Example:
72+
73+
```typescript
74+
import { type MagnitudeConfig } from 'magnitude-test';
75+
76+
export default {
77+
url: "...",
78+
continueAfterFailure: true,
79+
llm: {
80+
//...
81+
}
82+
} satisfies MagnitudeConfig;
83+
```
84+
85+
## Test URL resolution
6586

6687
Each test uses a URL that is built from the broader scope of configuration in this order:
6788

0 commit comments

Comments
 (0)