Date created: 2023-10-18
Developed
- Our performance analyst sends a manual report to form creators (OR main contacts)
- In order of importance for service teams:
- Submissions
- Completion rate
- Question funnel
- Previously supplied: questions amended from the ‘check your answers’ page - these are low in number, users seem more likely to use the browser forward/back buttons
- Submissions and completion rates over time
- Dropouts/pain points
- Ability to download raw data
- Some of the Google Analytics metrics such as device type if/when we implement that on the forms runner (doing anything ourselves would be fraught with data privacy issues). They could then self serve these
- Form creators can look at basic data relating to their forms’ performance
- Admins from other government departments (OGDs) to be able to see the performance of all of their OGD forms
- Number of submitted forms
- Number of unfinished forms - started but not completed
- Completion rate - as a percentage (%)
- A snapshot of the last week of data:
- This will only cover the previous 7 days
- The previous 7 days will include the day before the form creator looks at it, but not the day they’re looking at it (meaning ‘today’s’ data)
- It will change depending when the user looks at the form, day-to-day
- No option to filter dates
- No data over 7 days old
- Form creators can still ask us to manually produce this information, but it’s not to be expected
- No question funnel showing the dropouts at page level:
- This is something we currently provide, and it’s been used to make improvements to forms when first going live
- This is something we'll try to look at in a future iteration, once we’re confident in the data collection method
When form creators first make their forms live they can go to view their form. They’ll be presented with the ‘live’ state view of their form with the details they added to create it.
As part of this screen we’ll introduce a placeholder for the “Form metrics for the past 7 days”.
Within this section form creators are presented with inset text telling them:
No metrics are available yet as no-one has started or submitted a form since it went live.
Once they have, you’ll be able to see the following for the past 7 days:
- Completion rate
- Number of forms completed
- Number of forms started but not completed
The rest of the screen has not been changed: it shows the rest of the form information including a way to preview their form.
This version of the ‘live’ form view now shows the form creator that they are seeing “Form metrics for the past 3 days: 29 September to 1 October 2023”.
There’s a paragraph at the start of this section telling the form creator what they should expect to be included in the data:
The metrics shown here are for less than a week. To see a full week’s data, check again when your form’s been live for 7 days.
They are then presented with 3 separate pieces of data. These are displayed next to each other as though they're blocks.
The first box shows “Completion rate” with the figure “87%” beneath it.
The second box shows “Forms submitted” with the figure “87” beneath it.
The third box shows “Forms started but not completed” with the figure “13” beneath it.
This version of the ‘live’ form view now shows the form creator that they’re seeing “Form metrics for the past 7 days: 25 September to 2 October 2023”.
There’s a paragraph at the start of this section telling the form creator the limitations of the data shown:
If you want to track metrics over a longer period you'll need to make a note of these on the same day each week.
They’re then present with 3 separate pieces of data displayed next to each other as though they’re blocks.
The first box shows “Completion rate” with the figure “75%” beneath it.
The second box shows “Forms submitted” with the figure “4” beneath it.
The third box shows “Forms started but not completed” with the figure “1” beneath it.
This version of the screen introduces a section where the form has been live for more than 7 days but there were no submissions.
The section heading has changed to “Form metrics for the past 7 days: 25 September to 2 October 2023”.
Within this section form creators are presented with inset text telling them:
No metrics are available as no-one has started or submitted a form in the past 7 days.
This may be because the form is no longer published on GOV.UK.
This version of the screen shows that there has either been an error with the data storage (CloudWatch) or the system was unable to get the data requested.
This would only appear where there’s been a server request error.
Plan and run UR on data dashboard / analytics needs
We’ve not currently tested the design implementation with users but our researcher has done a preliminary round of research with current partners to understand the following:
- How are users getting on with the current data they receive from our performance analyst?
- What data are they using the most? And for what purpose?
- Are they sharing or tracking data in any way, and how?
- Are there any needs or trends we can see that would be impacted by our initial agreed MVP?
Notes: Data and Analytics needs (Google document)
Playback - Form data and analytics (Google deck)
Research playback: Data & Analytics (Recording)