Skip to content

Conversation

@micheles
Copy link
Contributor

@micheles micheles commented Oct 12, 2023

Also improved the monitoring to measure the slow spots. Part of #9003. Here is @CatalinaYepes calculation on oq1:

| calc_54926, maxmem=0.4 GB | time_sec | memory_mb | counts |
|---------------------------+----------+-----------+--------|
| total gen_event_based     | 46_522   | 34.5      | 1000   |
| reading mea,tau,phi       | 17_410   | 0.0       | 1000   |
| computing gmfs            | 4_345    | 0.0       | 1000   |
| EventBasedCalculator.run  | 210.9    | 76.8      | 1      |
| filtering ruptures        | 49.0     | 0.0       | 1000   |
| saving gmfs               | 7.36327  | 0.25781   | 1000   |

As I suspected, it can be faster to recompute mea,tau,phi on every task rather than reading such arrays.

@micheles micheles added this to the Engine 3.18.0 milestone Oct 12, 2023
@raoanirudh
Copy link
Member

qa_tests_data/event_based_risk/reinsurance_1/gmfs.hdf5: stray file being committed?

@micheles micheles merged commit 016c411 into master Oct 12, 2023
@micheles micheles deleted the mea_tau_phi branch October 12, 2023 05:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants