Skill: To generate test cases for validating a web app

[jyejare]

Describe the contribution to the taxonomy

• The skill has been added to generate test cases for validating web app
• The question and answer contains test cases for usability, security, load, performance and API validation.

Contribution checklist

• The contribution was tested with ilab generate
• No errors or warnings were produced by ilab generate
• All commits are signed off (DCO)
• The qna.yaml file contains at least 5 seed_examples
• The qna.yaml file was linted and prettified (yaml-validator can do both)
• An attribution.txt file in the same folder as the qna.yaml file
• Content does not include PII or otherwise sensitive or confidential information
• Content does not include anything documented in the project's Avoid these Topics guidelines

[instruct-lab-bot]

Beep, boop 🤖, Hi, I'm @instructlab-bot and I'm going to help you with your pull request. Thanks for you contribution! 🎉

I support the following commands:

• @instructlab-bot precheck -- Check existing model behavior using the questions in this proposed change.
• @instructlab-bot generate -- Generate a sample of synthetic data using the synthetic data generation backend infrastructure.
• @instructlab-bot generate-local -- Generate a sample of synthetic data using a local model.
• @instructlab-bot help -- Print this help message again.

Note

Results or Errors of these commands will be posted as a pull request check in the Checks section below

Note

Currently only maintainers belongs to [[taxonomy-triagers taxonomy-approvers taxonomy-maintainers instructlab-bot-triagers instructlab-bot-maintainers oversight-committee]] teams are allowed to run these commands.

[jyejare]

@instructlab-bot generate-local

[instruct-lab-bot]

User jyejare is not allowed to run the InstructLab bot. Only [taxonomy-triagers taxonomy-approvers taxonomy-maintainers instructlab-bot-triagers instructlab-bot-maintainers oversight-committee] teams are allowed to access the bot functions.

[github-actions]

This pull request has been automatically marked as stale because it has not had activity within 15 days. It will be automatically closed if no further activity occurs within the next 31 days.

[jjasghar]

This is an interesting skill, we should check against the model(s) but if this isn't already there, this seems like a great addition.

[jyejare]

@jjasghar I verified this against merlinite-7b-lab-Q4_K_M before training the model and later.

Before Training it returns some XML like random data. Whereas after training the models with these skills, it had returned me the perfect answer.

[github-actions]

This pull request has been automatically marked as stale because it has not had activity within 15 days. It will be automatically closed if no further activity occurs within the next 31 days.

[jyejare]

@jjasghar Here is the chat details using the trained model :

# gitrepos ilab model chat --model ./instructlab-merlinite-7b-lab-trained/instructlab-merlinite-7b-lab-Q4_K_M.gguf 
╭────────────────────────────────────────────────────────────────────────────────────────────────────── system ──────────────────────────────────────────────────────────────────────────────────────────────────────╮
│ Welcome to InstructLab Chat w/ ./INSTRUCTLAB-MERLINITE-7B-LAB-TRAINED/INSTRUCTLAB-MERLINITE-7B-LAB-Q4_K_M.GGUF (type /h for help)                                                                                  │
╰────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
>>> hello there                                                                                                                                                                                           [S][default]
╭───────────────────────────────────────────────────────────────── ./instructlab-merlinite-7b-lab-trained/instructlab-merlinite-7b-lab-Q4_K_M.gguf ──────────────────────────────────────────────────────────────────╮
│ Hello! How can I help you today?                                                                                                                                                                                   │
╰──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────── elapsed 0.344 seconds ─╯
>>> Write a simple test case for web server login                                                                                                                                                         [S][default]
╭───────────────────────────────────────────────────────────────── ./instructlab-merlinite-7b-lab-trained/instructlab-merlinite-7b-lab-Q4_K_M.gguf ──────────────────────────────────────────────────────────────────╮
│ Steps:                                                                                                                                                                                                             │
│ 1. Navigate to the login page on your web server.                                                                                                                                                                  │
│ 2. Enter a valid username and password.                                                                                                                                                                            │
│ 3. Click "Login."                                                                                                                                                                                                  │
│ 4. Observe that you are taken to the homepage or another appropriate page after successful login.                                                                                                                  │
╰──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────── elapsed 2.119 seconds ─╯
>>> Write a test for validating the language is changed in web pages, when changed in global setting.                                                                                                     [S][default]
╭───────────────────────────────────────────────────────────────── ./instructlab-merlinite-7b-lab-trained/instructlab-merlinite-7b-lab-Q4_K_M.gguf ──────────────────────────────────────────────────────────────────╮
│ Steps:                                                                                                                                                                                                             │
│ 1. Visit your website with any of its languages.                                                                                                                                                                   │
│ 2. Go to the global settings and change the preferred language.                                                                                                                                                    │
│ 3. Reload or refresh the webpage.                                                                                                                                                                                  │
│ 4. Observe that the content changes according to your choice of new language.                                                                                                                                      │
╰──────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────── elapsed 2.210 seconds ─╯

[github-actions]

This pull request has been automatically marked as stale because it has not had activity within 15 days. It will be automatically closed if no further activity occurs within the next 31 days.

[github-actions]

This pull request has been automatically marked as stale because it has not had activity within 15 days. It will be automatically closed if no further activity occurs within the next 31 days.