Skip to content

Make licensee's degree of parallelism configurable #640

Closed
@jkbschmid

Description

@jkbschmid

Licensee is currently always limited to a maximum of 10 parallel processes per scan, which can lead to large fluctuations in the crawler's overall compute footprint, since it can suddenly start using 10 more cores.

await Promise.all(paths.map(throat(10, path => this._runOnFolder(path, root, parameters))))

Could we make this configurable, so users can reduce the degree of parallelism if they require a more predictable compute footprint?
This is similar to a previous issue about scancode's degree of parallelism (#609).

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions