Skip to content

Custom Tests specification documentation #69

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 4 commits into
base: trunk
Choose a base branch
from

Conversation

Luc45
Copy link
Member

@Luc45 Luc45 commented May 6, 2025

This PR is a working-in-progress, and a description will be added when it's ready for review.

@@ -0,0 +1,78 @@
# Other Frameworks

QIT Custom E2E Tests **uses Playwright by default, but it is framework-agnostic by design**. Runners that emit **[CTRF](https://ctrf.io)** results can be integrated, although such setups are considered *experimental* and must be maintained by the implementer.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This sentence is correct but it sounds a bit rigid and explicit:

Runners that emit **[CTRF](https://ctrf.io)** results can be integrated, although such setups are considered *experimental* and must be maintained by the implementer.

Maybe we can turn it into an opportunity to build community around the custom tests?:

You can integrate any test runner that provides [CTRF](https://ctrf.io/) reports, but only Playwright will be officially supported . Community-maintained integrations are welcome!


### 2. Integration steps

**Create `qit-e2e.json`**

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would keep the titles more descriptive than super accurate. For example, here I would say something like:
Create a specification file.

We're mentioning later that you need to add a qit-e2e.json file so I don't think we need to repeat it in the title.

Also, I think this line serves as a title, maybe we can replace the bold syntax with a minor title? Something like:

##### Create a specification file


**Create `qit-e2e.json`**

In the **root of your test directory** (where your test framework’s config typically lives), add a `qit-e2e.json` file. QIT relies on this file to know how to set up and run your tests. Start with an example like this:

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Would it help if we added an example of a test path for devs to see what this folder would look like and how the qit-e2e.json file should be placed in relation to this folder?

}
```

See more options for the `qit-e2e.json` file in the [specification](../specification.md).

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'd try to reference to this file as the specification in order to establish our own knowledge base of the entities that are part of the QIT architecture. We could say something like:

See more configuration options in the [specification](../specification.md).


From your WordPress plugin or theme directory, run:

```qitbash

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In all these sections we provide instructions on how to proceed by suggesting commands in the terminal. Apart from these instructions, would it be good if we provided an example in order to remove any minimal potential doubt users might have?

Apologies if I'm too pushy with examples 😆 I just believe they're one of the best ways to learn something new, which would be good to keep our documentation easy to understand both for experienced and new developers, or even vibe coders / no-coders.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants