-
Notifications
You must be signed in to change notification settings - Fork 28
Open
Description
SUMMARY
Facing mismatch issue in nightly runners but not able to produce in local run. Able to replicate, when we tested mobilenet_v2 along with runner test cases list. Two cases causing some changes, which makes mobilenet_v2 to fail
TESTCASES
- forge/test/models/paddlepaddle/multimodal/paddleocr/test_paddleocr.py::test_paddleocr[https://raw.githubusercontent.com/PaddlePaddle/PaddleOCR/main/ppocr/utils/ppocr_keys_v1.txt-forge/test/models/paddlepaddle/multimodal/paddleocr/cached_models-https://raw.githubusercontent.com/ycdhqzhiai/PaddleOCR-demo/main/imgs/11.jpg-https://paddleocr.bj.bcebos.com/PP-OCRv4/chinese/ch_PP-OCRv4_det_infer.tar-https://paddleocr.bj.bcebos.com/PP-OCRv4/chinese/ch_PP-OCRv4_rec_infer.tar]
- forge/test/models/paddlepaddle/multimodal/paddleocr/test_paddleocr_det.py::test_paddleocr_detv4_det_ch-[https://paddleocr.bj.bcebos.com/PP-OCRv4/chinese/ch_PP-OCRv4_det_infer.tar]
- forge/test/models/paddlepaddle/vision/mobilenet/test_mobilenet_v2.py::test_mobilenetv2_basic
FAILURE REASON
When we run in above order, we can able to get data mismatch issue as below
2026-01-23 10:06:43.777 | INFO | forge.compiled_graph_state:__call__:315 - Running model pd_mobilenetv2_basic_cv_image_cls_paddlemodels forward on device...
2026-01-23 10:06:56.820 | ERROR | forge.verify.compare:compare_pcc:218 - Tensor mismatch. PCC = 0.2647323738268329, but required = 0.95
ERROR LOGS
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels