Describe the bug
The robvis web tool (https://www.riskofbias.info/welcome/robvis-visualization-tool) does not support the complete QUADAS-2 assessment framework. It only accepts and visualizes the Risk of Bias domains (4 domains) but does not support the Applicability domains (3 domains), which are an integral part of the QUADAS-2 tool. When attempting to upload a complete QUADAS-2 dataset with 9 columns (Study + 4 Risk of Bias domains + 3 Applicability domains + Overall), the tool rejects the file with an error message.
To Reproduce
Steps to reproduce the behavior:
Go to 'https://www.riskofbias.info/welcome/robvis-visualization-tool'
Select Tool: 'QUADAS-2'
Under 'Data options', ensure 'Judgement' is set to default or any option
Click on 'Load data' and upload a CSV/Excel file with the following structure:
Column 1: Study (study names)
Columns 2-5: D1, D2, D3, D4 (Risk of Bias domains)
Columns 6-8: D1.1, D2.1, D3.1 (Applicability domains)
Column 9: Overall
Click 'Generate Plots'
See error message: "WARNING: Incorrect number of columns in uploaded. The number of columns in your data does not match the number expected for the QUADAS-2 tool, using the options defined above. The expected number of domains is 6: a 'Study' column, 4 'Domain' columns, and an 'Overall' column."
Expected behavior
The QUADAS-2 tool should support both Risk of Bias AND Applicability assessments, as specified in the official QUADAS-2 guidelines (Whiting et al., 2011). Users should be able to:
Upload a dataset with 9 columns (Study, D1-D4 for Risk of Bias, D1.1-D3.1 or A1-A3 for Applicability, Overall)
Generate visualizations showing both Risk of Bias and Applicability assessments
Have the option to visualize:
Risk of Bias only (6 columns)
Risk of Bias + Applicability (9 columns)
Applicability only (5 columns)
The current implementation forces users to choose between visualizing Risk of Bias OR Applicability, but not both together, which is not aligned with proper QUADAS-2 methodology.
Screenshots
Error message received when uploading a 9-column QUADAS-2 dataset:
"WARNING: Incorrect number of columns in uploaded. The number of columns in your data does not match the number expected for the QUADAS-2 tool."
Desktop (please complete the following information):
OS: Windows 11
Browser: Chrome
Version: 131.0.6778.86
Additional context
According to the QUADAS-2 framework (Whiting PF, et al. "QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies." Ann Intern Med. 2011), the tool consists of:
Risk of Bias Assessment (4 domains):
Patient Selection
Index Test
Reference Standard
Flow and Timing
Applicability Assessment (3 domains):
Patient Selection
Index Test
Reference Standard
Both components are essential for a complete quality assessment of diagnostic accuracy studies. The current limitation forces researchers to either:
Create two separate visualizations (one for Risk of Bias, one for Applicability)
Omit the Applicability assessment entirely
This is a significant limitation that affects the proper implementation of QUADAS-2 methodology in systematic reviews.
Suggested Solution:
Add a "Judgement" option in the Data Options section with:
"Risk of Bias only" (expects 6 columns)
"Applicability only" (expects 5 columns)
"Both Risk of Bias and Applicability" (expects 9 columns)
When "Both" is selected, the visualization should show:
Summary plots for both Risk of Bias and Applicability
Traffic light plots showing all domains side by side
References:
Whiting PF, Rutjes AW, Westwood ME, et al. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. 2011;155(8):529-536. doi:10.7326/0003-4819-155-8-201110180-00009
Impact:
This limitation affects researchers conducting systematic reviews of diagnostic accuracy studies who need to properly report both Risk of Bias and Applicability concerns as per Cochrane and PRISMA guidelines for diagnostic test accuracy reviews.
Describe the bug
The robvis web tool (https://www.riskofbias.info/welcome/robvis-visualization-tool) does not support the complete QUADAS-2 assessment framework. It only accepts and visualizes the Risk of Bias domains (4 domains) but does not support the Applicability domains (3 domains), which are an integral part of the QUADAS-2 tool. When attempting to upload a complete QUADAS-2 dataset with 9 columns (Study + 4 Risk of Bias domains + 3 Applicability domains + Overall), the tool rejects the file with an error message.
To Reproduce
Steps to reproduce the behavior:
Go to 'https://www.riskofbias.info/welcome/robvis-visualization-tool'
Select Tool: 'QUADAS-2'
Under 'Data options', ensure 'Judgement' is set to default or any option
Click on 'Load data' and upload a CSV/Excel file with the following structure:
Column 1: Study (study names)
Columns 2-5: D1, D2, D3, D4 (Risk of Bias domains)
Columns 6-8: D1.1, D2.1, D3.1 (Applicability domains)
Column 9: Overall
Click 'Generate Plots'
See error message: "WARNING: Incorrect number of columns in uploaded. The number of columns in your data does not match the number expected for the QUADAS-2 tool, using the options defined above. The expected number of domains is 6: a 'Study' column, 4 'Domain' columns, and an 'Overall' column."
Expected behavior
The QUADAS-2 tool should support both Risk of Bias AND Applicability assessments, as specified in the official QUADAS-2 guidelines (Whiting et al., 2011). Users should be able to:
Upload a dataset with 9 columns (Study, D1-D4 for Risk of Bias, D1.1-D3.1 or A1-A3 for Applicability, Overall)
Generate visualizations showing both Risk of Bias and Applicability assessments
Have the option to visualize:
Risk of Bias only (6 columns)
Risk of Bias + Applicability (9 columns)
Applicability only (5 columns)
The current implementation forces users to choose between visualizing Risk of Bias OR Applicability, but not both together, which is not aligned with proper QUADAS-2 methodology.
Screenshots
Error message received when uploading a 9-column QUADAS-2 dataset:
"WARNING: Incorrect number of columns in uploaded. The number of columns in your data does not match the number expected for the QUADAS-2 tool."
Desktop (please complete the following information):
OS: Windows 11
Browser: Chrome
Version: 131.0.6778.86
Additional context
According to the QUADAS-2 framework (Whiting PF, et al. "QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies." Ann Intern Med. 2011), the tool consists of:
Risk of Bias Assessment (4 domains):
Patient Selection
Index Test
Reference Standard
Flow and Timing
Applicability Assessment (3 domains):
Patient Selection
Index Test
Reference Standard
Both components are essential for a complete quality assessment of diagnostic accuracy studies. The current limitation forces researchers to either:
Create two separate visualizations (one for Risk of Bias, one for Applicability)
Omit the Applicability assessment entirely
This is a significant limitation that affects the proper implementation of QUADAS-2 methodology in systematic reviews.
Suggested Solution:
Add a "Judgement" option in the Data Options section with:
"Risk of Bias only" (expects 6 columns)
"Applicability only" (expects 5 columns)
"Both Risk of Bias and Applicability" (expects 9 columns)
When "Both" is selected, the visualization should show:
Summary plots for both Risk of Bias and Applicability
Traffic light plots showing all domains side by side
References:
Whiting PF, Rutjes AW, Westwood ME, et al. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. 2011;155(8):529-536. doi:10.7326/0003-4819-155-8-201110180-00009
Impact:
This limitation affects researchers conducting systematic reviews of diagnostic accuracy studies who need to properly report both Risk of Bias and Applicability concerns as per Cochrane and PRISMA guidelines for diagnostic test accuracy reviews.