We're a little inconstant about this right now, sometimes deleting it right away (causing issues if the item is restored) and sometimes not, waiting for the purge. We should double check that soft-deleted items with attachments actually have their attachments deleted when a purge of soft-deletes happens.