Skip to content

Conversation

@glitchminer
Copy link
Contributor

@glitchminer glitchminer commented Jul 16, 2025

closes #18588

What does the PR do

e2e framework for tablet and mobile builds

Initial framework for e2e tablet / mobile builds:

Supporting setup, teardown and 1 fixture for onboarding with password.

Logging and reports in various formats.

Environment:
Able to run on lambdatest and local environment and be triggered by github action using LT URL, URL of APK to upload, run ID of a github action with APK as artifact.

GitHub Action demo

https://github.com/status-im/status-desktop/actions/runs/17068784181

image
lt.mp4

@glitchminer glitchminer requested a review from anastasiyaig July 16, 2025 08:06
@glitchminer glitchminer self-assigned this Jul 16, 2025
@status-im-auto
Copy link
Member

status-im-auto commented Jul 16, 2025

Jenkins Builds

Click to see older builds (67)
Commit #️⃣ Finished (UTC) Duration Platform Result
✔️ 6ee8de1 #1 2025-07-16 08:14:02 ~6 min tests/nim 📄log
✔️ 6ee8de1 #1 2025-07-16 08:19:09 ~11 min macos/aarch64 🍎dmg
✔️ 6ee8de1 #1 2025-07-16 08:19:50 ~12 min tests/ui 📄log
✔️ 6ee8de1 #1 2025-07-16 08:22:23 ~15 min linux/x86_64 📦tgz
✔️ 6ee8de1 #1 2025-07-16 08:31:10 ~23 min windows/x86_64 💿exe
✔️ 34c1920 #2 2025-07-16 14:30:26 ~6 min tests/nim 📄log
✔️ 34c1920 #2 2025-07-16 14:33:39 ~9 min macos/aarch64 🍎dmg
✔️ 34c1920 #2 2025-07-16 14:36:42 ~13 min linux/x86_64 📦tgz
✔️ 34c1920 #2 2025-07-16 14:36:50 ~13 min tests/ui 📄log
✔️ 34c1920 #2 2025-07-16 14:44:19 ~20 min windows/x86_64 💿exe
✔️ cff659d #3 2025-07-16 18:23:03 ~6 min tests/nim 📄log
✔️ cff659d #3 2025-07-16 18:23:49 ~7 min macos/aarch64 🍎dmg
✔️ cff659d #3 2025-07-16 18:28:08 ~11 min tests/ui 📄log
✔️ cff659d #3 2025-07-16 18:33:18 ~16 min linux/x86_64 📦tgz
✔️ cff659d #3 2025-07-16 18:36:52 ~20 min windows/x86_64 💿exe
✔️ 06d7424 #4 2025-07-17 14:16:12 ~6 min tests/nim 📄log
✔️ 06d7424 #4 2025-07-17 14:17:40 ~8 min macos/aarch64 🍎dmg
✔️ 06d7424 #4 2025-07-17 14:22:13 ~12 min tests/ui 📄log
✔️ 06d7424 #4 2025-07-17 14:22:25 ~13 min linux/x86_64 📦tgz
✔️ 06d7424 #4 2025-07-17 14:32:19 ~22 min windows/x86_64 💿exe
✔️ fc30d84 #5 2025-07-17 22:44:13 ~6 min tests/nim 📄log
✔️ fc30d84 #5 2025-07-17 22:45:52 ~8 min macos/aarch64 🍎dmg
✔️ fc30d84 #5 2025-07-17 22:49:13 ~11 min tests/ui 📄log
✔️ fc30d84 #5 2025-07-17 22:51:09 ~13 min linux/x86_64 📦tgz
✔️ fc30d84 #5 2025-07-17 22:59:23 ~21 min windows/x86_64 💿exe
✔️ fc30d84 #1 2025-08-08 08:31:18 ~21 min linux/x86_64 📦tgz
✔️ fc30d84 #1 2025-08-09 14:15:18 ~18 min linux/x86_64 📦tgz
✔️ eccd35b #6 2025-08-12 16:08:08 ~7 min tests/nim 📄log
✔️ eccd35b #6 2025-08-12 16:12:29 ~11 min tests/ui 📄log
✔️ eccd35b #6 2025-08-12 16:12:49 ~11 min macos/aarch64 🍎dmg
✔️ eccd35b #6 2025-08-12 16:17:33 ~16 min linux/x86_64 📦tgz
✔️ eccd35b #1 2025-08-12 16:20:33 ~19 min macos/aarch64-nwaku 🍎dmg
✔️ eccd35b #2 2025-08-12 16:21:27 ~20 min linux/x86_64-nwaku 📦tgz
✔️ eccd35b #6 2025-08-12 16:24:31 ~23 min windows/x86_64 💿exe
✖️ eccd35b pr18366 2025-08-12 16:29:22 ~11 min tests/e2e 📊rpt
7c2a466 #7 2025-08-13 16:33:44 ~4 min macos/aarch64 📄log
7c2a466 #2 2025-08-13 16:33:44 ~4 min macos/aarch64-nwaku 📄log
✔️ 7c2a466 #7 2025-08-13 16:36:06 ~7 min tests/nim 📄log
✔️ 7c2a466 #7 2025-08-13 16:41:01 ~12 min tests/ui 📄log
✔️ 7c2a466 #7 2025-08-13 16:42:00 ~13 min linux/x86_64 📦tgz
✔️ 7c2a466 #3 2025-08-13 16:50:42 ~22 min linux/x86_64-nwaku 📦tgz
✔️ 7c2a466 #7 2025-08-13 16:52:25 ~23 min windows/x86_64 💿exe
✖️ 7c2a466 pr18366 2025-08-13 16:53:35 ~11 min tests/e2e 📊rpt
✔️ 846e262 #8 2025-08-14 21:36:25 ~7 min tests/nim 📄log
✔️ 846e262 #8 2025-08-14 21:41:19 ~11 min macos/aarch64 🍎dmg
✔️ 846e262 #8 2025-08-14 21:41:44 ~12 min tests/ui 📄log
✔️ 846e262 #8 2025-08-14 21:42:48 ~13 min linux/x86_64 📦tgz
✔️ 846e262 #3 2025-08-14 21:44:21 ~15 min macos/aarch64-nwaku 🍎dmg
✔️ 846e262 #4 2025-08-14 21:50:31 ~21 min linux/x86_64-nwaku 📦tgz
✔️ 846e262 #8 2025-08-14 21:51:50 ~22 min windows/x86_64 💿exe
✔️ 846e262 pr18366 2025-08-14 21:53:25 ~10 min tests/e2e 📊rpt
9fa9175 #4 2025-08-18 08:29:12 ~3 min macos/aarch64-nwaku 📄log
✔️ 9fa9175 #9 2025-08-18 08:32:47 ~6 min tests/nim 📄log
✔️ 9fa9175 #9 2025-08-18 08:38:01 ~11 min macos/aarch64 🍎dmg
✔️ 9fa9175 #9 2025-08-18 08:38:12 ~12 min tests/ui 📄log
✔️ 9fa9175 #9 2025-08-18 08:39:59 ~14 min linux/x86_64 📦tgz
✔️ 9fa9175 #5 2025-08-18 08:44:54 ~19 min linux/x86_64-nwaku 📦tgz
✔️ 9fa9175 #9 2025-08-18 08:48:38 ~22 min windows/x86_64 💿exe
✔️ 9fa9175 pr18366 2025-08-18 08:50:54 ~10 min tests/e2e 📊rpt
e6e8710 #5 2025-08-18 17:08:26 ~2 min macos/aarch64-nwaku 📄log
e6e8710 #10 2025-08-18 17:08:26 ~2 min macos/aarch64 📄log
✔️ e6e8710 #10 2025-08-18 17:12:13 ~6 min tests/nim 📄log
✔️ e6e8710 #10 2025-08-18 17:18:00 ~12 min tests/ui 📄log
✔️ e6e8710 #10 2025-08-18 17:20:05 ~14 min linux/x86_64 📦tgz
✔️ e6e8710 #6 2025-08-18 17:26:22 ~21 min linux/x86_64-nwaku 📦tgz
✔️ e6e8710 #10 2025-08-18 17:28:05 ~22 min windows/x86_64 💿exe
✖️ e6e8710 pr18366 2025-08-18 17:30:17 ~10 min tests/e2e 📊rpt
Commit #️⃣ Finished (UTC) Duration Platform Result
✔️ 0e83a57 #11 2025-08-19 09:44:57 ~7 min tests/nim 📄log
✔️ 0e83a57 #11 2025-08-19 09:49:43 ~11 min macos/aarch64 🍎dmg
✔️ 0e83a57 #11 2025-08-19 09:50:16 ~12 min tests/ui 📄log
✔️ 0e83a57 #11 2025-08-19 09:51:45 ~14 min linux/x86_64 📦tgz
✔️ 0e83a57 #6 2025-08-19 09:55:07 ~17 min macos/aarch64-nwaku 🍎dmg
✔️ 0e83a57 #7 2025-08-19 09:58:36 ~20 min linux/x86_64-nwaku 📦tgz
✔️ 0e83a57 #11 2025-08-19 10:01:14 ~23 min windows/x86_64 💿exe
✔️ 0e83a57 pr18366 2025-08-19 10:04:03 ~12 min tests/e2e 📊rpt
✔️ 048a75d #12 2025-08-19 12:02:50 ~6 min tests/nim 📄log
✔️ 048a75d #12 2025-08-19 12:09:08 ~12 min tests/ui 📄log
✔️ 048a75d #12 2025-08-19 12:19:49 ~23 min windows/x86_64 💿exe
✔️ 048a75d #13 2025-08-19 13:05:15 ~13 min linux/x86_64 📦tgz
✔️ 048a75d pr18366 2025-08-19 13:16:07 ~10 min tests/e2e 📊rpt
✔️ 048a75d #13 2025-08-19 13:47:14 ~9 min macos/aarch64 🍎dmg

@glitchminer glitchminer force-pushed the test/e2e_appium/add-e2e_appium-framework branch 2 times, most recently from 06d7424 to fc30d84 Compare July 17, 2025 22:37
Copy link

@fbarbu15 fbarbu15 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Amazing job @glitchminer
This already looks mature and I love the structure

I left some comments, mostly just thinking out loud

@jakubgs
Copy link
Member

jakubgs commented Jul 24, 2025

Why are we doing these e2e test on GitHub and not in Jenkins? Our release pipelines are in Jenkins, and we'll need to run e2e tests for both desktop and mobile for release builds in Jenkins.

@glitchminer
Copy link
Contributor Author

Why are we doing these e2e test on GitHub and not in Jenkins? Our release pipelines are in Jenkins, and we'll need to run e2e tests for both desktop and mobile for release builds in Jenkins.

Hi @jakubgs, I agree, they can and should be run in Jenkins as part of the pipelines as well. First though, I think the core functionality of the framework needs completed, which we're targeting for completion in the next few weeks.

At the time of planning, there was no CI builds or pipeline available. The idea of adding a workflow dispatch option in the mean time served the purpose of being able to test the functionality of framework itself, which is still under development (there is only a single test flow as POC), before integrating elsewhere.

Once the framework is stable with some test coverage, Jenkins pipeline integration will be the immediate next step. The GitHub workflows will then just serve as a convenience to manually specify and initiate ad-hoc testing when needed.

@jakubgs
Copy link
Member

jakubgs commented Aug 1, 2025

Cool, just keep in mind to not put too much into the Github actions config and keep things re-usable for Jenkins pipelines.

Thanks.

@glitchminer glitchminer force-pushed the test/e2e_appium/add-e2e_appium-framework branch 3 times, most recently from 7c2a466 to 846e262 Compare August 14, 2025 21:28
@glitchminer glitchminer marked this pull request as ready for review August 15, 2025 08:53
@glitchminer glitchminer requested a review from fbarbu15 August 15, 2025 08:53
@glitchminer glitchminer changed the title WIP: test(e2e_appium): add e2e_appium chore(e2e_appium): add e2e_appium Aug 15, 2025
@glitchminer glitchminer force-pushed the test/e2e_appium/add-e2e_appium-framework branch from 9fa9175 to e6e8710 Compare August 18, 2025 17:05
Copy link

@fbarbu15 fbarbu15 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks. Added one more comment.
Also please share a link in the PR description with a github actions CI run because I cannot find it

@glitchminer glitchminer force-pushed the test/e2e_appium/add-e2e_appium-framework branch from 0e83a57 to 048a75d Compare August 19, 2025 11:56
@glitchminer glitchminer requested a review from fbarbu15 August 19, 2025 12:23
@glitchminer
Copy link
Contributor Author

Thanks. Added one more comment. Also please share a link in the PR description with a github actions CI run because I cannot find it

Thanks @fbarbu15, fixed now. I had tested github action on a different repo which is why it wasn't visible, added an action on push for this branch now (instead of just dispatch) so you can see it. Link in PR description.

Copy link

@fbarbu15 fbarbu15 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice job!! LGTM

@glitchminer glitchminer merged commit e94c79d into master Aug 19, 2025
8 of 11 checks passed
@glitchminer glitchminer deleted the test/e2e_appium/add-e2e_appium-framework branch August 19, 2025 13:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Tests: Initial e2e_appium framework

7 participants