unskip evo2 tests

[broland-hat]

Description

• This PR addresses issue [BUG] NeMo upgrade supporting hyena flash decode requires more memory for generation #1013
  • In NeMo hyena/evo2: Make sure to convert to real after fp32 conversion NVIDIA-NeMo/NeMo#14515, the code was updated to reduce memory consumption
  • This PR updates the NeMo version to 7ccb0d4.
  • This PR adjusts the memory thresholds to skip tests in sub-packages/bionemo-evo2/tests/bionemo/evo2/test_evo2.py
  • This PR adds some tools for torch memory usage.

Type of changes

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds functionality)
• Refactor
• Documentation update
• Other (please describe):

CI Pipeline Configuration

Configure CI behavior by applying the relevant labels:

• SKIP_CI - Skip all continuous integration tests
• INCLUDE_NOTEBOOKS_TESTS - Execute notebook validation tests in pytest
• INCLUDE_SLOW_TESTS - Execute tests labelled as slow in pytest for extensive testing

Note

By default, the notebooks validation tests are skipped unless explicitly enabled.

Authorizing CI Runs

We use copy-pr-bot to manage authorization of CI
runs on NVIDIA's compute resources.

• If a pull request is opened by a trusted user and contains only trusted changes, the pull request's code will
  automatically be copied to a pull-request/ prefixed branch in the source repository (e.g. pull-request/123)
• If a pull request is opened by an untrusted user or contains untrusted changes, an NVIDIA org member must leave an
  /ok to test comment on the pull request to trigger CI. This will need to be done for each new commit.

Usage

# TODO: Add code snippet

Pre-submit Checklist

• I have tested these changes locally
• I have updated the documentation accordingly
• I have added/updated tests as needed
• All existing tests pass successfully

Local test runs

the slow test test_evo2.py::test_golden_values_top_k_logits_and_cosine_similarity_7b is broken on main, will be marked skip

• (1 ) test_evo2.py::test_golden_values_top_k_logits_and_cosine_similarity_7b is broken on this commit with NVIDIA H100 80GB HBM3
• pytests_pr1058_unskip_evo2_tests_sub-packages-bionemo-evo2-tests-bionemo-evo2-test_evo2_20250821T0024_6e2a005d.log
• (2) The same test as in (1) is broken on the commit 424050d2 in main with NVIDIA H100 80GB HBM3
  pytests_pr1058_unskip_evo2_tests_sub-packages-bionemo-evo2-tests-bionemo-evo2-test_evo2__test_golden_values_top_k_logits_and_cosine_similarity_7b_20250821T2114_main_424050d2.log

the slow test test_evo.py::test_generate_speed is marked skip per https://nvidia.slack.com/archives/C074Z808N05/p1755185565520729?thread_ts=1755097791.370249&cid=C074Z808N05

[copy-pr-bot]

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

[jstjohn]

/ok to test 9537a47

[pstjohn]

/ok to test 6e2a005

[broland-hat]

/okay to test 2b9ccdb

[farhadrgh]

LGTM

[broland-hat]

/okay to test 28586e5

[broland-hat]

/okay to test '628d090'

[broland-hat]

/okay to skip 320ed0a

[broland-hat]

/okay to test 320ed0a

[broland-hat]

/okay to test 83f152a

[broland-hat]

/okay to test 1f95151

[broland-hat]

/okay to test 9e85a76