PLU-345: FormSG table field

[kevinkim-ogp]

NOTE: this is not a blocker for beta; intent is to release this while beta is happening

TL;DR

This PR adds support for FormSG table fields in the For-Each action, enabling users to iterate through table data from FormSG submissions.

What changed?

• Added functionality to convert FormSG table field into table object to enable preview of row data and to use in for-each actions
• Added a new input source type FORMSG_TABLE to the For-Each action
• Updated the For-Each action to handle FormSG table fields, allowing iteration through table rows
• Added test cases for the new table field functionality
• Hide form cell values if there are no rows

How to test?

1. Create a FormSG form with a table field
2. Set up a workflow that uses the FormSG trigger

• Mock data

  • Should still show the individual cell values as "Response X, Row 1 Column 1" etc
  • Should have preview in test result
  • Modal should show all columns in the table
  • Modal should show 2 rows of mock data with each column filled

• Actual submission

  • Should show the individual cell values with column headers if headers do not contain commas, otherwise resort to default (Column 1, Column 2, etc.)
  • Should have preview in test result
    • Preview should column headers if headers do not contain commas, otherwise default column names
  • Modal should show all columns in the table
  • Modal should show correct rows of mock data with each column filled

• Actual submission with no data

  • Should NOT show individual cell values
  • Should NOT be able to preview

Why make this change?

FormSG table fields contain structured data that users often need to process row by row. This change enables users to iterate through table rows in a FormSG submission, making it possible to perform actions on each row of data separately.

Screenshots

FormSG table preview
(can ignore the form connection issue, happens on local dev)

Preview with mock data

FormSG variable in for-each

[kevinkim-ogp]

• PLU-345: FormSG table field #1069 👈 (View in Graphite)
• chore: allow variable replacement in single select mode #1090 : 1 other dependent PR (#1093 )
• chore: mark iteration as partial success #1089
• feat: new badge for actions #1088
• chore: use step name in suggestions popover #1067
• trunk/for-each

This stack of pull requests is managed by Graphite. Learn more about stacking.

[datadog-opengovsg]

Datadog Report

Branch report: feat/for-each/formsg-table-support
Commit report: 587247e
Test service: plumber

✅ 0 Failed, 1011 Passed, 0 Skipped, 2m 57.99s Total Time
⬆️ Test Sessions change in coverage: 1 increased (+0.07%)

[pregnantboy]

looks good. works with 0 rows, deleted columns.

maybe refactor the isformtable check. too many if else cases

[Copilot]

Pull Request Overview

This PR adds support for FormSG table fields in the For-Each action, enabling users to iterate through table data from FormSG submissions. The implementation converts FormSG table fields into structured table objects compatible with the existing For-Each functionality.

• Adds FormSG table field processing to convert table data into a standardized format
• Extends For-Each action to support FormSG table input source
• Updates frontend to properly handle FormSG table field previews and empty table states

Reviewed Changes

Copilot reviewed 15 out of 15 changed files in this pull request and generated 5 comments.

Show a summary per file

File	Description
packages/frontend/src/components/VariablesList/schema.ts	Added FormSG table data parsing and schema validation
packages/frontend/src/components/VariablesList/TableVariableItem.tsx	Added conditional modal opening for empty tables
packages/frontend/src/components/FlowStepTestController/utils.tsx	Added FormSG table input source handling and parameter matching logic
packages/backend/src/apps/toolbox/common/constants.ts	Added FORMSG_TABLE constant and table sources array
packages/backend/src/apps/toolbox/actions/for-each/schema.ts	Extended schema to support FormSG table input source
packages/backend/src/apps/toolbox/actions/for-each/index.ts	Updated action logic to handle FormSG table sources
packages/backend/src/apps/toolbox/actions/for-each/get-data-out-metadata.ts	Updated metadata generation for FormSG table sources
packages/backend/src/apps/formsg/triggers/new-submission/get-mock-data.ts	Added table object conversion for mock data
packages/backend/src/apps/formsg/triggers/new-submission/get-data-out-metadata.ts	Added table metadata building and visibility logic
packages/backend/src/apps/formsg/common/process-table-field.ts	New utility to convert FormSG table fields to structured format
packages/backend/src/apps/formsg/auth/decrypt-form-response.ts	Added table field processing during response decryption

[datadog-opengovsg]

✅ Tests

🎉 All green!

❄️ No new flaky tests detected
🧪 All tests passed

_{This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 315d263 | Was this helpful? Give us feedback!}