Currently failed payments can only be deleted when actively triggered by the user via the deletepayments rpc. We should provide a config setting which let's the user automatically garbage-collect the payments similar to how its done with invoices:

; gc-canceled-invoices-on-startup=false
; gc-canceled-invoices-on-the-fly=false