Skip to content

fix: Issues found during STO to JSON migration - #13714

Merged
john-gom merged 3 commits into
mainfrom
sto_to_json_fixes
Jun 6, 2026
Merged

fix: Issues found during STO to JSON migration#13714
john-gom merged 3 commits into
mainfrom
sto_to_json_fixes

Conversation

@john-gom

@john-gom john-gom commented Jun 4, 2026

Copy link
Copy Markdown
Contributor

What

  • Remove broken symbolic links when migrating from STO to JSON
  • Make migraiton script more robust and log files that can't be processed

Signed-off-by: John Gomersall <thegoms@gmail.com>
@teolemon

teolemon commented Jun 4, 2026

Copy link
Copy Markdown
Member

A file with those problematic products would indeed be very interesting

@codecov-commenter

codecov-commenter commented Jun 4, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 54.83%. Comparing base (a4889dd) to head (8a92de6).
⚠️ Report is 1 commits behind head on main.
✅ All tests successful. No failed tests found.

Additional details and impacted files
@@            Coverage Diff             @@
##             main   #13714      +/-   ##
==========================================
+ Coverage   49.58%   54.83%   +5.25%     
==========================================
  Files          99      100       +1     
  Lines       25846    25904      +58     
  Branches     6172     6181       +9     
==========================================
+ Hits        12816    14205    +1389     
+ Misses      11360     9867    -1493     
- Partials     1670     1832     +162     
Flag Coverage Δ
integration-test-group-1 9.09% <0.00%> (?)
integration-test-group-2 9.25% <0.00%> (?)
integration-test-group-3 33.05% <0.00%> (?)
integration-test-group-4 28.69% <0.00%> (?)
integration-test-group-5 9.15% <0.00%> (?)
integration-test-group-6 9.69% <0.00%> (?)
integration-test-group-7 28.25% <0.00%> (?)
integration-test-group-8 26.50% <0.00%> (?)
integration-test-group-9 13.17% <0.00%> (?)
unit-test-group-1 24.13% <0.00%> (ø)
unit-test-group-2 34.84% <0.00%> (ø)
unit-test-group-3 23.49% <0.00%> (ø)
unit-test-group-4 29.89% <100.00%> (ø)
unit-test-group-5 17.23% <0.00%> (ø)
unit-test-group-6 27.28% <0.00%> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@john-gom

john-gom commented Jun 5, 2026

Copy link
Copy Markdown
Contributor Author

A file with those problematic products would indeed be very interesting

I'll upload the log to this issue when it's done

@john-gom

john-gom commented Jun 6, 2026

Copy link
Copy Markdown
Contributor Author

@teolemon FYI log file attached. The lines with "Error processing..." are showing files in the product directory that are not valid JSON or STO files. Note there are a few re-starts in there.
2025_05_convert_sto_to_json.pl.log

john-gom and others added 2 commits June 6, 2026 11:50
Signed-off-by: John Gomersall <thegoms@gmail.com>
@john-gom
john-gom marked this pull request as ready for review June 6, 2026 10:50
@john-gom
john-gom requested a review from a team as a code owner June 6, 2026 10:50
@sonarqubecloud

sonarqubecloud Bot commented Jun 6, 2026

Copy link
Copy Markdown

@john-gom
john-gom enabled auto-merge (squash) June 6, 2026 11:09

@stephanegigandet stephanegigandet left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you!

@john-gom
john-gom merged commit ccfee79 into main Jun 6, 2026
39 checks passed
@john-gom
john-gom deleted the sto_to_json_fixes branch June 6, 2026 19:29
@github-project-automation github-project-automation Bot moved this from To discuss and validate to Done in 🍊 Open Food Facts Server issues Jun 6, 2026
stephanegigandet pushed a commit that referenced this pull request Jun 8, 2026
🤖 I have created a release *beep* *boop*
---


##
[2.94.0](v2.93.1...v2.94.0)
(2026-06-08)


### Features

* FDC import script
([#13320](#13320))
([264c146](264c146))


### Bug Fixes

* add U+25CF (●) to ingredient separators for Japanese labels
([#13691](#13691))
([ed740f6](ed740f6))
* backward compatibility for API ask for refactored tags fields
([#13689](#13689))
([345779e](345779e))
* Issues found during STO to JSON migration
([#13714](#13714))
([ccfee79](ccfee79))
* nginx priority map
([#13723](#13723))
([4068a1e](4068a1e))
* reset to-be-exported on pro platform
([#13703](#13703))
([ac8cc84](ac8cc84))
* use recipe estimator for ingredient analysis (and test tool)
([#13715](#13715))
([1768b7d](1768b7d))

---
This PR was generated with [Release
Please](https://github.com/googleapis/release-please). See
[documentation](https://github.com/googleapis/release-please#release-please).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

Development

Successfully merging this pull request may close these issues.

4 participants