This month, the number of verified packages increased a lot.
This has two reasons:
1. I added a 'nachbauall' script to handle multibuild packages.
2. on 2025-01-10 a lot of packages were rebuilt for the removal of python310. This helped because I use the osc build -p (prefer) option and it has limitations. e.g. if a package was built with go1.22 and I provide that old rpm, it will still use go1.23 for the build. Also prjconf changes can cause issues.

Verified packages are those where I was able to produce identical or equivalent (per build-compare) packages outside of OBS. Debian and Arch do such checks using rebuilderd.
https://rb.zq1.de/compare.factory/build-compare-differed-builds-nachbau.txt lists packages that could not be verified. Most of these have known issues.

ghc still causes issues for verification of ~80 packages.
There is some randomness added, when debuginfo is enabled.
I also configured the tests to build these with debuginfo, because it makes a difference there, so the numbers will look a bit worse from that.

On the positive side, I saw fewer build-failures than ever, so we get the clearest view on the current state.


https://github.com/openSUSE/obs-build/pull/1047 stands out as a surprising bug that affected multiple packages, but only when trying to build them on a host with a non-UTC timezone.
Another similar issue showed up, when changes entries had unparseable dates, such as "Fri Dez 11 16:35:40 UTC 2020" (notice 'Dez' instead of 'Dec') - then the result depended on the current date.

https://build.opensuse.org/requests/1235463 brought a toolchain fix that helped 'rusty_v8' and there seems to have been another toolchain fix, because some other rust reproducibility issues vanished as well.

Meanwhile for my Reproducible-Builds-Operating-System (RBOS) project (sponsored by a NLnet NGI0 grant), I reached a new level of reproducibility by producing bit-identical rpms in OBS, osc build and pbuild and verifying this for most packages in https://build.opensuse.org/project/show/home:bmwiedemann:reproducible:distribution:ring0 . Only multibuild packages need more scripting work here.