Spike: Multiple 10-10d submits in a day

[baltes]

As DOCMP, I need to understand why some users appear to be submitting form 10-10d more than once in the same day.

Refer to VA email and Teams for details on example submits

This came out of feedback we received in production from our VA partners. @andrea-merrill or @baltes can forward the email to your VA emails when this is started.

Acceptance criteria

• We understand how often this is happening
• We have reviewed the examples provided and can provide hypotheses about the users' sessions
• We understand any differences between submits (whether or not form contents and supported docs are the same)
• We have attempted to rule out the possibility that a software defect is contributing to the multiple submits

[michaelclement]

Not directly related, but if we create some helper methods that do a bit of this inspection for us, we should add them to the suggestion list in this ticket.

[michaelclement]

Made some progress on this. Working to build out some utilities that we can permanently add to our backend to do inspection of production data.

[michaelclement]

10-10D submits over the last 30 days:

10,818 unique email addresses
613 unique email addresses associated with repeat submissions
5.67% of submitters have 2 or more submissions
--
Number of users with 9 submissions: 2
Number of users with 6 submissions: 3
Number of users with 5 submissions: 2
Number of users with 4 submissions: 8
Number of users with 3 submissions: 55
Number of users with 2 submissions: 543
Number of users with 1 submissions: 10,205
--
Avg time between resubmits for users with 9 submissions: 1 days, 8 hours, 9 minutes, 41 seconds
Avg time between resubmits for users with 6 submissions: 2 days, 14 hours, 45 minutes, 34 seconds
Avg time between resubmits for users with 5 submissions: 20 minutes, 22 seconds
Avg time between resubmits for users with 4 submissions: 1 days, 11 hours, 51 minutes, 2 seconds
Avg time between resubmits for users with 3 submissions: 1 days, 18 hours, 19 minutes, 54 seconds
Avg time between resubmits for users with 2 submissions: 3 days, 7 hours, 17 minutes, 3 seconds

[michaelclement]

Waiting on the email referenced above so I can do some more specific spot checking on this issue.

[michaelclement]

Sent relevant information via VA Teams chat to Andrea and Premal since there was some PII. Basically, it seems like there are just a fair amount of users resubmitting, but the durations between their submits + the regular variation in the number of attachments make it look like it's normal user behavior rather than any sort of system defect.