Skip to content

Small improvements to transform records tasks and docs#66

Merged
proddata merged 4 commits into
mainfrom
proddata/transform-records-improvement
Mar 19, 2026
Merged

Small improvements to transform records tasks and docs#66
proddata merged 4 commits into
mainfrom
proddata/transform-records-improvement

Conversation

@proddata
Copy link
Copy Markdown
Contributor

@proddata proddata commented Mar 19, 2026

Improves the plugin-transform-records docs and expression language.

What changed

  • adds plugin long-form docs for the transform records tasks and aligns subgroup metadata/header copy
  • clarifies generated task/property docs for Aggregate, Map, Select, Filter, Unnest, and Zip
  • supports = as an equality alias alongside ==`
  • adds avg() to the shared expression engine used by Map/Filter/Select/Unnest
    • aligns average behavior across shared expressions and Aggregate, using rounded division without noisy trailing zeros
  • adds in (...) as a membership operator in the shared expression engine

@aj-emerich maybe you can look at the docs changes 469b78d

Align avg() rounding with Aggregate by using an explicit fixed scale. This keeps Map/Filter/Select behavior consistent with Aggregate and avoids failures on non-terminating decimal division.
Implement membership checks as a real operator with explicit parenthesized candidates, e.g. field in ("FR", "DE"). This keeps the shared expression language consistent across Filter, Map, Select, and Unnest without adding list literals or a filter-only special case.
@proddata proddata requested a review from fdelbrayelle March 19, 2026 10:45
@github-project-automation github-project-automation Bot moved this to To review in Pull Requests Mar 19, 2026
@proddata proddata requested a review from aj-emerich March 19, 2026 10:45
@proddata proddata changed the title Proddata/transform-records-improvement Small improvements to transform records tasks and docs Mar 19, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Mar 19, 2026

📦 Artifacts

Name Size Updated Expiration
jar 6.16 MB Mar 19, 26, 10:47:13 AM UTC Mar 26, 26, 10:47:12 AM UTC

🧪 Java Unit Tests

TestsPassed ✅Skipped ⚠️FailedTime ⏱
Java Tests Report135 ran134 ✅1 ⚠️0 ❌47s 702ms

🔁 Unreleased Commits

✅ No unreleased commits found.

Copy link
Copy Markdown
Member

@aj-emerich aj-emerich left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Docs structure LGTM, and we should utilize this long description more

@proddata proddata merged commit 1035e6d into main Mar 19, 2026
6 checks passed
@proddata proddata deleted the proddata/transform-records-improvement branch March 19, 2026 12:26
@github-project-automation github-project-automation Bot moved this from To review to Done in Pull Requests Mar 19, 2026
@MilosPaunovic MilosPaunovic added the kind/external Pull requests raised by community contributors label Mar 31, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

kind/external Pull requests raised by community contributors

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

4 participants