Skip to content

perf: only evaluate one system#1010

Closed
fricklerhandwerk wants to merge 2 commits intoNixOS:mainfrom
fricklerhandwerk:only-eval-linux
Closed

perf: only evaluate one system#1010
fricklerhandwerk wants to merge 2 commits intoNixOS:mainfrom
fricklerhandwerk:only-eval-linux

Conversation

@fricklerhandwerk
Copy link
Copy Markdown
Collaborator

This may lose some coverage, as it won't catch packages that only exist on the other platforms.
But it reduces evaluation time and storage consuption to 1/4.

@NixOS/security would that constitute a notable negative impact for your purposes?

This may lose some coverage, as it won't catch packages that only exist on the other platforms.
But it reduces evaluation time and storage consumption to 1/4.
@LeSuisse
Copy link
Copy Markdown
Member

would that constitute a notable negative impact for your purposes?

Seems like a fair trade. We might lose a bit of coverage on specific Darwin software but I suppose that's reasonable. The only thing I have in mind is iterm2. Do you have the ability to check if for the published issues we have others that were only matched on Darwin aarch64?

@fricklerhandwerk fricklerhandwerk force-pushed the only-eval-linux branch 2 times, most recently from cbb10b7 to a440542 Compare April 28, 2026 18:06
@fricklerhandwerk
Copy link
Copy Markdown
Collaborator Author

Darwin-only packages from published issues in production:

  • emacs-macport
  • emacs30-macport
  • ghostty-bin
  • pam-reattach
  • pam-watchid
  • python312Packages.mitmproxy-macos
  • python313Packages.mitmproxy-macos
  • python314Packages.mitmproxy-macos
  • swiftlint
  • tests.fetchNextcloudApp.simple-sha512
  • tests.fetchpatch.relative
  • tests.fetchpatch2.relative

So we can't meaningfully not evaluate for Darwin...

And looking at all packages, there's no strict superset of all the platforms. They have non-overlapping portions at least in the hundreds.

I guess the only way for now is to deduplicate the derivation metadata by a lot to save the space, and make evaluation results asynchronously available.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants