ci/eval: add rebuildsByPlatform to the comparison result

[GaetanLepage]

Things done

Follow-up of #362844

This adds a new key to the JSON generated by the compare function.
It lists the rebuilds for each platform.
This will make Mic92/nixpkgs-review#433 way easier.

cc @infinisil @Mic92

• Built on platform(s)
  • x86_64-linux
  • aarch64-linux
  • x86_64-darwin
  • aarch64-darwin
• For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)
  • sandbox = relaxed
  • sandbox = true
• Tested, as applicable:
  • NixOS test(s) (look inside nixos/tests)
  • and/or package tests
  • or, for functions and "core" functionality, tests in lib/tests or pkgs/test
  • made sure NixOS tests are linked to the relevant packages
• Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
• Tested basic functionality of all binary files (usually in ./result/bin/)
• 25.05 Release Notes (or backporting 24.11 and 25.05 Release notes)
  • (Package updates) Added a release notes entry if the change is major or breaking
  • (Module updates) Added a release notes entry if the change is significant
  • (Module addition) Added a release notes entry if adding a new NixOS module
• Fits CONTRIBUTING.md.

---

Add a 👍 reaction to pull requests you find important.

[Mic92]

Test run: Mic92#40

[GaetanLepage]

Test run: Mic92#40

It seems like the comparison step does not run.

[Mic92]

Test run: Mic92#40

It seems like the comparison step does not run.

@infinisil how can we test this in our own forks?

[infinisil]

@Mic92 Need to also push something on the master branch to get the eval there going

[Mic92]

Ah maybe the issue is that my base branch is called main and not master?

[GaetanLepage]

I was able to test in my fork:

• mock changes: https://github.com/GaetanLepage/nixpkgs/pull/4/files
• Result: https://github.com/GaetanLepage/nixpkgs/actions/runs/12280021794?pr=4

[GaetanLepage]

{
  "attrdiff": {
    "added": [
      "gh-cal-bis"
    ],
    "changed": [
      "python311Packages.equinox",
      "python311Packages.flowmc",
      "python311Packages.lineax",
      "python311Packages.optimistix",
      "python312Packages.equinox",
      "python312Packages.flowmc",
      "python312Packages.lineax",
      "python312Packages.optimistix"
    ],
    "removed": [
      "materialize",
      "quake3demo"
    ]
  },
  "labels": [
    "10.rebuild-darwin: 1-10",
    "10.rebuild-linux: 1-10"
  ],
  "rebuildCountByKernel": {
    "darwin": 9,
    "linux": 9
  },
  "rebuildsByKernel": {
    "darwin": [
      "gh-cal-bis",
      "python311Packages.equinox",
      "python311Packages.flowmc",
      "python311Packages.lineax",
      "python311Packages.optimistix",
      "python312Packages.equinox",
      "python312Packages.flowmc",
      "python312Packages.lineax",
      "python312Packages.optimistix"
    ],
    "linux": [
      "gh-cal-bis",
      "python311Packages.equinox",
      "python311Packages.flowmc",
      "python311Packages.lineax",
      "python311Packages.optimistix",
      "python312Packages.equinox",
      "python312Packages.flowmc",
      "python312Packages.lineax",
      "python312Packages.optimistix"
    ]
  },
  "rebuildsByPlatform": {
    "aarch64-darwin": [
      "gh-cal-bis",
      "python311Packages.equinox",
      "python311Packages.flowmc",
      "python311Packages.lineax",
      "python311Packages.optimistix",
      "python312Packages.equinox",
      "python312Packages.flowmc",
      "python312Packages.lineax",
      "python312Packages.optimistix"
    ],
    "aarch64-linux": [
      "gh-cal-bis",
      "python311Packages.equinox",
      "python311Packages.flowmc",
      "python311Packages.lineax",
      "python311Packages.optimistix",
      "python312Packages.equinox",
      "python312Packages.flowmc",
      "python312Packages.lineax",
      "python312Packages.optimistix"
    ],
    "x86_64-darwin": [
      "gh-cal-bis",
      "python311Packages.equinox",
      "python311Packages.lineax",
      "python311Packages.optimistix",
      "python312Packages.equinox",
      "python312Packages.lineax",
      "python312Packages.optimistix"
    ],
    "x86_64-linux": [
      "gh-cal-bis",
      "python311Packages.equinox",
      "python311Packages.flowmc",
      "python311Packages.lineax",
      "python311Packages.optimistix",
      "python312Packages.equinox",
      "python312Packages.flowmc",
      "python312Packages.lineax",
      "python312Packages.optimistix"
    ]
  }
}