Skip to content

Commit 477c3c5

Browse files
Remove xfail marker and update test duration (#3034)
### Summary In today’s nightly pipeline, several models previously marked as `xfail` have now passed successfully. So - Removed `xfail` markers for **Swin**, **BLIP**, and **CLIP** PaddlePaddle models. - Updated test durations for **Ernie** and **GLM** PaddlePaddle models and **NBeats** ONNX models. ### Detailed Test Results | **Test Path** | **Status** | **Failure (if any)** | **Prev Duration (s)** | **Current Duration (s)** | |----------------|------------|----------------------|-----------------------|--------------------------| | `forge/test/models/paddlepaddle/text/glm/test_glm.py::test_glm[THUDM/glm-large-chinese]` | ❌ **Failed** | `tvm.error.OpNotImplemented: share_data` | 183.16 | 652.521 | | `forge/test/models/onnx/vision/swin/test_swin.py::test_swin_v2_tiny_masked_onnx[microsoft/swinv2-tiny-patch4-window8-256]` | ✅ **Passed** | — | 591.81 | 553.997 | | `forge/test/models/paddlepaddle/text/ernie/test_ernie.py::test_ernie_for_sequence_classification[ernie-1.0]` | ✅ **Passed** | — | 201.608 | 439.756 | | `forge/test/models/paddlepaddle/text/t5/test_t5.py::test_t5_conditional_generation[t5-base]` | ❌ **Failed** | `tvm.error.OpNotImplemented: conditional_block, select_input` | 536.16 | 136.287 | | `forge/test/models/onnx/timeseries/test_nbeats_onnx.py::test_nbeats_with_seasonality_basis_onnx[seasionality_basis]` | ❌ **Failed** | `ValueError: Data mismatch (AutomaticValueChecker)` | 120.44 | 168.031 | | `forge/test/models/paddlepaddle/multimodal/blip/test_blip.py::test_blip[Salesforce/blip-image-captioning-base]` | ✅ **Passed** | — | 477.72 | 473.577 | | `forge/test/models/paddlepaddle/multimodal/clip/test_chineseclip.py::test_chineseclip[OFA-Sys/chinese-clip-vit-base-patch16]` | ✅ **Passed** | — | 397.86 | 216.907 |
1 parent 3917f94 commit 477c3c5

File tree

4 files changed

+3
-6
lines changed

4 files changed

+3
-6
lines changed

.test_durations

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -23500,7 +23500,7 @@
2350023500
"forge/test/models/paddlepaddle/multimodal/blip/test_blip.py::test_blip_text[Salesforce/blip-image-captioning-base]": 312.226,
2350123501
"forge/test/models/paddlepaddle/text/albert/test_albert.py::test_albert_maskedlm[input0-albert-chinese-tiny]": 37.596,
2350223502
"forge/test/models/paddlepaddle/text/bert/test_bert.py::test_bert_question_answering[cl-tohoku/bert-base-japanese-input1]": 157.885,
23503-
"forge/test/models/paddlepaddle/text/ernie/test_ernie.py::test_ernie_for_sequence_classification[ernie-1.0]": 201.608,
23503+
"forge/test/models/paddlepaddle/text/ernie/test_ernie.py::test_ernie_for_sequence_classification[ernie-1.0]": 439.756,
2350423504
"forge/test/models/paddlepaddle/text/roberta/test_roberta.py::test_roberta_sequence_classification[hfl/rbt4]": 142.64,
2350523505
"forge/test/models/onnx/text/phi1/test_phi1_onnx.py::test_phi1_clm_onnx[microsoft/phi-1]": 0.001,
2350623506
"forge/test/models/onnx/vision/alexnet/test_alexnet_onnx.py::test_alexnet_onnx": 21.733,
@@ -23527,7 +23527,7 @@
2352723527
"forge/test/models/pytorch/vision/yolo/test_yolo_v4.py::test_yolov4_tiny": 0.859,
2352823528
"forge/test/models/paddlepaddle/multimodal/blip/test_blip.py::test_blip_vision[Salesforce/blip-image-captioning-base]": 325.629,
2352923529
"forge/test/models/paddlepaddle/multimodal/blip/test_blip.py::test_blip[Salesforce/blip-image-captioning-base]": 477.72,
23530-
"forge/test/models/paddlepaddle/text/glm/test_glm.py::test_glm[THUDM/glm-large-chinese]": 183.16,
23530+
"forge/test/models/paddlepaddle/text/glm/test_glm.py::test_glm[THUDM/glm-large-chinese]": 652.521,
2353123531
"forge/test/models/pytorch/atomic/hippynn/test_hippynn.py::test_hippynn": 1.047,
2353223532
"forge/test/models/pytorch/text/flux/test_flux.py::test_flux[black-forest-labs/FLUX.1-schnell]": 0.549,
2353323533
"forge/test/models/pytorch/text/llama/test_llama3.py::test_llama3_causal_lm[meta-llama/Meta-Llama-3.1-70B]": 0.584,
@@ -50256,6 +50256,6 @@
5025650256
"forge/test/models/pytorch/text/phi1/test_phi1_5.py::test_phi1_5_token_classification_pytorch[microsoft/phi-1_5]": 407.22,
5025750257
"forge/test/models/pytorch/vision/yolo/test_yolo_v8.py::test_yolov8[yolov8x]": 455.56,
5025850258
"forge/test/models/pytorch/vision/detr/test_detr.py::test_detr_segmentation[resnet_50_panoptic]": 257.31,
50259-
"forge/test/models/onnx/timeseries/test_nbeats_onnx.py::test_nbeats_with_seasonality_basis_onnx[seasionality_basis]": 120.44,
50259+
"forge/test/models/onnx/timeseries/test_nbeats_onnx.py::test_nbeats_with_seasonality_basis_onnx[seasionality_basis]": 168.031,
5026050260
"forge/test/models/pytorch/text/xglm/test_xglm.py::test_xglm_causal_lm[xglm-1.7B]": 274.53
5026150261
}

forge/test/models/onnx/vision/swin/test_swin.py

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -56,7 +56,6 @@ def test_swin_v2_tiny_image_classification_onnx(variant, forge_tmp_path):
5656

5757

5858
@pytest.mark.nightly
59-
@pytest.mark.xfail(reason="https://github.com/tenstorrent/tt-forge-fe/issues/2998")
6059
@pytest.mark.parametrize("variant", ["microsoft/swinv2-tiny-patch4-window8-256"])
6160
def test_swin_v2_tiny_masked_onnx(variant, forge_tmp_path):
6261

forge/test/models/paddlepaddle/multimodal/blip/test_blip.py

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -78,7 +78,6 @@ def test_blip_vision(variant):
7878

7979

8080
@pytest.mark.nightly
81-
@pytest.mark.xfail(reason="https://github.com/tenstorrent/tt-forge-fe/issues/2998")
8281
@pytest.mark.parametrize("variant", variants)
8382
def test_blip(variant):
8483
# Record Forge properties

forge/test/models/paddlepaddle/multimodal/clip/test_chineseclip.py

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -89,7 +89,6 @@ def test_chineseclip_vision(variant):
8989

9090

9191
@pytest.mark.nightly
92-
@pytest.mark.xfail(reason="https://github.com/tenstorrent/tt-forge-fe/issues/2998")
9392
@pytest.mark.parametrize("variant", variants)
9493
def test_chineseclip(variant):
9594
# Record Forge properties

0 commit comments

Comments
 (0)