Skip to content

Use cell-specific ESP32 output tolerances - #10

Merged
asteinh merged 1 commit into
developfrom
benchmarks/esp32-device-tolerance
Jul 21, 2026
Merged

Use cell-specific ESP32 output tolerances#10
asteinh merged 1 commit into
developfrom
benchmarks/esp32-device-tolerance

Conversation

@asteinh

@asteinh asteinh commented Jul 21, 2026

Copy link
Copy Markdown
Member

Summary

  • encode the observed TFLM ESP-NN versus host TFLite bound as a four-LSB tolerance for that cell only
  • retain the one-LSB TiGrIS limit and expose the existing CLI flag as an explicit global override
  • clarify that matched TiGrIS ONNX is reconstructed from the embedded TFLite model
  • test both sides of the TFLM boundary and ensure TiGrIS remains strict

Evidence

The fresh ten-cell ESP32-S3 SiliconRig capture completed. TFLM DS-CNN differed by at most 4 INT8 units (same winning class; 4.61e-7 at the output scale); TiGrIS DS-CNN differed by at most 1; all four MobileNet TiGrIS cells were exact. Re-validating the complete raw matrix with this cell-specific contract passes all ten cells.

Validation

  • 13 ESP result/orchestrator unit tests pass
  • 26 repository provenance/core tests pass
  • full captured matrix validates without rerunning hardware
  • tracked JSON validation and diff checks pass

@asteinh
asteinh merged commit 2905323 into develop Jul 21, 2026
2 checks passed
@asteinh
asteinh deleted the benchmarks/esp32-device-tolerance branch July 21, 2026 13:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant