Observed
The Remove Annotation quick-fix only works for a single annotation at a time. To remove multiple in a file, you have to move to each individual instance and remove it.
Expected
The Remove Annotation quick-fix allows the user to apply it once, or to show the standard R# popup to apply it to the entire file, project, or solution.