DOC combine datasets notebooks into one

[romanlutz]

Describe the issue linked to the documentation

We started with one notebook per dataset (in the doc/code/orchestrators directory) and now it's becoming a lot. Since they all pretty much follow the same structure we should just have one overall and show the various datasets in their own sections.

Additional Information

Here are the current notebooks about datasets, which should be consolidated into one standard notebook:

• https://github.com/Azure/PyRIT/blob/main/doc/code/orchestrators/decoding_trust_stereotype_testing.ipynb
• https://github.com/Azure/PyRIT/blob/main/doc/code/orchestrators/harmbench_testing.ipynb
• https://github.com/Azure/PyRIT/blob/main/doc/code/orchestrators/many_shot_jailbreak.ipynb
• https://github.com/Azure/PyRIT/blob/main/doc/code/orchestrators/pku_safe_rlhf_testing.ipynb
• https://github.com/Azure/PyRIT/blob/main/doc/code/orchestrators/seclists_bias_testing.ipynb
• https://github.com/Azure/PyRIT/blob/main/doc/code/orchestrators/xstest_bias_testing.ipynb

[bhavanaeh]

Hi, is the expectation such that you just have one notebook which has all the code for all the datasets?

[nina-msft]

Hey @bhavanaeh !

That's the idea. We have one notebook per dataset at the current moment. Roman is asking for one Python Notebook on datasets since they have the same structure. You can then use each Dataset as an example in that notebook.

For example: https://github.com/Azure/PyRIT/blob/main/doc/code/targets/3_custom_targets.ipynb The custom targets notebook is one notebook with several examples.

I'd imagine the Datasets notebook would look similar, with examples for each dataset integration. I just updated the description of the issue to have links to all of the notebooks which currently talk about Datasets.

[bhavanaeh]

Awesome, thank you so much! If this is still up for grabs, I'd like to take a stab at it :)

[nina-msft]

You got it - thank you @bhavanaeh 🦝