Skip to content

[BUG] CI Test sim:citest fails intermittently for Linux sim-01 #16088

Closed
@lupyuen

Description

@lupyuen

Description / Steps to reproduce the issue

sim:citest is failing intermittently for the CI Job Linux sim-01:
https://github.com/apache/nuttx/actions/runs/14120849141/job/39560745665#step:7:227

Configuration/Tool: sim/citest
test_framework/test_cmocka.py::test_cmocka FAILED                        [  0%]
test_framework/test_cmocka.py::test_cmocka ERROR                         [  0%]
test_example/test_example.py::test_hello FAILED                          [  0%]
test_example/test_example.py::test_hello ERROR                           [  0%]
test_example/test_example.py::test_helloxx FAILED                        [  0%]

Workaround is to restart the CI Job Linux sim-01. If it fails, restart again.

The bug doesn't seem to be caused by a NuttX or Apps Commit. According to NuttX Build History: The same NuttX + Apps Commit will fail inconsistently:

Image

I reproduced the bug with Docker (do this a few times to reproduce the bug):

sudo docker run \
  -it \
  ghcr.io/apache/nuttx/apache-nuttx-ci-linux:latest \
  /bin/bash
cd
git clone https://github.com/apache/nuttx
git clone https://github.com/apache/nuttx-apps apps
pushd nuttx ; echo NuttX Source: https://github.com/apache/nuttx/tree/$(git rev-parse HEAD) ; popd
pushd apps  ; echo NuttX Apps: https://github.com/apache/nuttx-apps/tree/$(git rev-parse HEAD) ; popd
cd nuttx/tools/ci
./cibuild.sh -c -A -N -R testlist/sim-01.dat

## Wait for it to fail, press Ctrl-C, then:
cat ../../boards/sim/sim/sim/configs/citest/logs/sim/sim/*

Here's the log:
https://gist.github.com/lupyuen/849562eaf87b93411098c96ada4d43c5

nsh> cmocka --skip test_case_posix_timer|test_case_oneshot|write_default|read_default|burst_test|gpiotest01|test_playback.*|test_interaction.*|test_stress.*|test_capture.*
Cmocka Test Start.
Missing <source>
Usage: cmocka_driver_block -m <source>
Where:
  -m <source> Block device or mtd device mount location.
...
[ RUN      ] drivertest_pm
[  ERROR   ] --- 0 != 3
[   LINE   ] --- drivertest_pm.c:199: error: Failure!
[  FAILED  ] drivertest_pm
[==========] tests: 1 test(s) run.
[  PASSED  ] 0 test(s).
[  FAILED  ] tests: 1 test(s), listed below:
[  FAILED  ] drivertest_pm
...
[ RUN      ] drivertest_posix_timer
[  ERROR   ] --- 2019 is not within the range [1990, 2010]
[   LINE   ] --- drivertest_posix_timer.c:162: error: Failure!
[  FAILED  ] drivertest_posix_timer
[==========] tests: 1 test(s) run.
[  PASSED  ] 0 test(s).
[  FAILED  ] tests: 1 test(s), listed below:
[  FAILED  ] drivertest_posix_timer

On which OS does this issue occur?

[OS: Linux]

What is the version of your OS?

GitHub CI ubuntu-latest

NuttX Version

master

Issue Architecture

[Arch: simulator]

Issue Area

[Area: Build System]

Host information

No response

Verification

  • I have verified before submitting the report.

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions