Skip to content

Commit c4f21ff

Browse files
authored
Merge pull request #319 from branfosj/parallel
limit max parallel builds to 16 cores
2 parents 1628c0f + cfcb967 commit c4f21ff

File tree

1 file changed

+13
-1
lines changed

1 file changed

+13
-1
lines changed

docs/easybuild-v5/changes.md

+13-1
Original file line numberDiff line numberDiff line change
@@ -104,7 +104,19 @@ To disable trace output, either:
104104
105105
## Default maximum build parallelism is set to 16 (`max-parallel`) {: #max-parallel-16 }
106106
107-
*(more info soon, ideally including some "scaling" data for long-running builds like GCC, LLVM, OpenFOAM, ...)*
107+
For EasyBuild 5.0, we have changed to using at most 16 cores by default for builds. If there are fewer cores
108+
available then the number of available cores will be used. Where an easyconfig or easyblock specifies a lower level
109+
of parallelism to be used, then that is respected.
110+
111+
In recent years we have seen a large rise in the core counts of the systems used to build software. Before, we used
112+
all available cores for the build. This, however, can lead to problems with many threads building at once leads to
113+
poor performance for the filesystem or a build failure due to exhausting the available memory.
114+
115+
Tests were performed on two systems and the data from those tests is in the
116+
[initial pull request for the change](https://github.com/easybuilders/easybuild-framework/pull/4606). As can be seen
117+
from those tests, there was limited speed up seen when using more than 16 cores and anyone considering increasing this
118+
from the default of 16 should run selective tests to see if this will give a noticeable improvement in build times on
119+
their system.
108120
109121
---
110122

0 commit comments

Comments
 (0)