Skip to content

Add More Integration tests - #49

Merged
Jacob-Chmura merged 49 commits into
mainfrom
ci/add_integration_tests
Jun 30, 2025
Merged

Add More Integration tests#49
Jacob-Chmura merged 49 commits into
mainfrom
ci/add_integration_tests

Conversation

@Jacob-Chmura

@Jacob-Chmura Jacob-Chmura commented Jun 24, 2025

Copy link
Copy Markdown
Member

Purpose

The purpose of this PR is to add more examples into our integration test pipeline. Moving forward, every new example script should be wrapped in an integration test, and we should ensure the default parameters run out of the box at all times.

Key Changes

  • added integration tests for all examples in master
  • using tgbn-trade for node prop prediction as it's much smaller

Relevant Prs

Close #48

Out of scope

  • Parsing output log files to isolate the key metrics (performance and efficiency). I have this code working in one of my private repos
  • Optimizations (caching on the environment and data, run each integration test in parallel)

@Jacob-Chmura Jacob-Chmura self-assigned this Jun 24, 2025
@codecov

codecov Bot commented Jun 24, 2025

Copy link
Copy Markdown

Codecov Report

All modified and coverable lines are covered by tests ✅

📢 Thoughts on this report? Let us know!

@Jacob-Chmura
Jacob-Chmura marked this pull request as ready for review June 24, 2025 14:18

@shenyangHuang shenyangHuang left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

approve with some items we can discuss

'--time=0:10:00',
]
)
def test_edgebank_tgb_linkprop_pred(slurm_job_runner, dataset):

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

for integration tests, can't we just use a virtual environment that is setup already on disc and then all datasets will just be loaded? again, we can address this later

@pytest.mark.parametrize('dataset', ['tgbl-wiki'])
@pytest.mark.slurm(
resources=[
'--partition=main',

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

be aware, I think you can only launch a single job with --partition=main at mila at a given time

@pytest.mark.parametrize('dataset', ['tgbl-wiki'])
@pytest.mark.slurm(
resources=[
'--partition=main',

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

again, only a single main job at a time, other jobs will just pend until it finishes

Base automatically changed from ci/integration_self_host to main June 30, 2025 14:08
@Jacob-Chmura
Jacob-Chmura merged commit 8526778 into main Jun 30, 2025
6 checks passed
@Jacob-Chmura
Jacob-Chmura deleted the ci/add_integration_tests branch June 30, 2025 14:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add Other Methods to Integration CI

2 participants