Skip to content

fix(publish): close the ffmpeg and libosinfo runtime closure - #249

Merged
hanthor merged 1 commit into
mainfrom
import/consumer-closure-ffmpeg-osinfo
Sep 25, 2026
Merged

hanthor merged 1 commit into
mainfrom
import/consumer-closure-ffmpeg-osinfo

Conversation

@hanthor

@hanthor hanthor commented Sep 25, 2026

Copy link
Copy Markdown
Member

Why

The publish job's check "Validate Hummingbird-only consumer transaction" installs the config/bluefin-packages.toml contract using only this factory's repository and Hummingbird. Run 36073571248 failed it for two reasons:

  • libosinfo requires osinfo-db and osinfo-db-tools, which neither Hummingbird nor the factory provides.
  • ffmpeg-free libraries link sonames that neither repository provides: libqrencode.so.4, libass.so.9, libbs2b.so.0, liblilv-0.so.0, libmysofa.so.1, librubberband.so.3, libtesseract.so.5.5, libvidstab.so.1.2, libzimg.so.2. The build container resolved them from Fedora 44, but the consumer transaction cannot see Fedora.

The whole consumer transaction was then reproduced against run 36073571248's RPMs, the old seed and Hummingbird. That showed a few more gaps: libtinyxml2.so.11 (libmediainfo), libpgm-5.3.so.0 (Hummingbird's own zeromq, which libavformat pulls in via libzmq), poppler-data (Hummingbird's poppler), and libavdevice's libopenal, libcaca, libdc1394/libiec61883 and libklvanc.

Imported from Fedora Rawhide (13 recipes)

Each recipe was imported with tools/import_rawhide.py. Each Source0 is the upstream release URL, and its bytes match the SHA-512 in the imported sources file. The Fedora lookaside appears only in fallback_urls.

Recipe Stage Why at that stage Source0
libunibreak 0 no factory BuildRequires https://github.com/adah1972/libunibreak/archive/libunibreak_8_0/libunibreak-libunibreak_8_0.tar.gz
libmysofa 0 none https://github.com/hoene/libmysofa/archive/v1.3.5/libmysofa-1.3.5.tar.gz
zimg 0 none https://github.com/sekrit-twc/zimg/archive/release-3.0.6/zimg-3.0.6.tar.gz
tinyxml2 0 none https://github.com/leethomason/tinyxml2/archive/11.0.0/tinyxml2-11.0.0.tar.gz
openpgm 0 none https://github.com/steve-o/openpgm/archive/release-5-3-128.tar.gz
poppler-data 0 none (same entry as #246) https://poppler.freedesktop.org/poppler-data-0.4.11.tar.gz
libass 1 fribidi, libunibreak (0) https://github.com/libass/libass/releases/download/0.17.4/libass-0.17.4.tar.xz
libbs2b 1 libsndfile (0) https://downloads.sourceforge.net/project/bs2b/libbs2b/3.1.0/libbs2b-3.1.0.tar.lzma
vid.stab 1 orc (0) https://github.com/georgmartius/vid.stab/archive/05829db776069b7478dd2d90b6e0081668a41abc/vid.stab-05829db.tar.gz
libsamplerate 1 libsndfile (0) https://github.com/libsndfile/libsamplerate/releases/download/0.2.2/libsamplerate-0.2.2.tar.xz
osinfo-db-tools 1 libsoup3, json-glib, including the mingw libsoup3 (0) https://releases.pagure.org/libosinfo/osinfo-db-tools-1.12.0.tar.xz
rubberband 2 libsamplerate (1) https://breakfastquay.com/files/releases/rubberband-4.0.0.tar.bz2
osinfo-db 2 osinfo-db-tools (1) https://gitlab.com/libosinfo/osinfo-db/-/releases/v20260812/downloads/osinfo-db-dist-20260812.tar.xz

Fedora's libbs2b sources file pinned only an MD5. It is repinned to the SHA-512 of the same upstream bytes; the MD5 matches.

tools/import_rawhide.py now accepts dots in package names, so vid.stab can be imported. The change has tests.

In a quay.io/fedora/fedora:44 container with config/hummingbird.repo, every BuildRequires of the 13 specs resolves. No spec needs compat packages such as nettle3.10, none needs Rust crates, and every %changelog is in descending order.

ffmpeg features disabled instead

Each one follows the existing librabbitmq pattern: the BuildRequires is removed, the configure flag is switched to --disable-*, and a comment explains why. None of these features is in the Utah contract.

Feature Why
libtesseract (OCR filter) not in Hummingbird; importing it needs tesseract, leptonica and tessdata
lv2 (LV2 host; also drops the lv2 headers) not in Hummingbird; importing it needs lilv, serd, sord, sratom and zix
libqrencode no upstream URL serves qrencode 4.1.1's release tarball any more: fukuchi.org returns 404 and the GitHub releases have no assets
openal Fedora repacks openal-soft by hand (make_tarball.sh removes the bundled fmt and the non-free utils/*.def), so no upstream URL serves those bytes
libcaca not in Hummingbird; importing it needs libcaca, slang and freeglut
dc1394 bcond, off on every arch (drops libdc1394 and libiec61883) would need libdc1394, libiec61883, libavc1394 and libraw1394
libklvanc not in Hummingbird or the factory

Stage changes

  • ffmpeg stays at 3. That is above every new input: rubberband at 2 is the highest. Its consumers (localsearch 4, pipewire-libs-extra 6) therefore do not move.
  • libosinfo moves from 0 to 3. It BuildRequires osinfo-db (2), and a same-stage or earlier build could not see it. Its only factory consumer is localsearch at 4, which is still above it.

The recipe count grows from 373 to 386, so the count assertions and docs/architecture.md are updated: 386 recipes, 385 source targets, and 80 of 386 packages with a hand-assigned stage.

Validation

  • just check: everything passes up to its pytest step, which needs a system pytest. PYTHONPATH=. uvx --python 3.13 --with pyyaml --with jsonschema pytest tests -q passes (497 tests).
  • tools/source_pipeline.py <pkg> passes for all 13 new recipes.

Known issues, not changed here

  • ffmpeg (3) still BuildRequires factory packages from later stages: pkgconfig(libpulse) from pulseaudio (4), pkgconfig(sdl2) from sdl2-compat (4), pkgconfig(jack) from pipewire (6) and pkgconfig(gl) from libglvnd (6). These inversions were already there and are cycles, since pipewire-libs-extra consumes ffmpeg.
  • waypipe (0) BuildRequires libavcodec, libavutil and libswscale from ffmpeg (3). This was also already there.
  • feat: import Utah runtime dependencies with no factory recipe #246 also adds poppler-data. Whichever PR merges second has to drop the duplicate.

🤖 Generated with Claude Code

https://claude.ai/code/session_01QMTLsnqW2jtz5QsNC3W3qv

The publish gate installs the bluefin-packages.toml contract using only this
factory and Hummingbird, and run 36073571248 failed it: libosinfo requires
osinfo-db and osinfo-db-tools, and ffmpeg-free's libraries link sonames that
neither repository provides. The build root had resolved them from Fedora 44,
which the consumer transaction cannot see.

Import the Fedora Rawhide recipes for the 13 source packages the closure
still needs:

- osinfo-db, osinfo-db-tools (libosinfo)
- libass, libunibreak, libbs2b, libmysofa, vid.stab, zimg, rubberband,
  libsamplerate (libavfilter-free)
- tinyxml2 (libmediainfo links libtinyxml2.so.11)
- openpgm (Hummingbird's zeromq requires libpgm-5.3.so.0, and libavformat
  links libzmq)
- poppler-data (Hummingbird's poppler requires it; same entry as #246)

Each Source0 comes from the upstream release URL and matches the SHA-512 in
the imported `sources` file. The Fedora lookaside is a fallback only. The
libbs2b `sources` pinned only an MD5, so repin it to the SHA-512 of the same
upstream bytes (the MD5 matches). tools/import_rawhide.py now accepts dots in
package names so that vid.stab can be imported.

Disable the ffmpeg-free features whose libraries are in neither Hummingbird
nor the factory, the same way librabbitmq was already dropped. None of them
is in the Utah contract:

- tesseract (OCR filter; would need tesseract, leptonica, tessdata)
- lv2/lilv (LV2 host; would need lilv, serd, sord, sratom, zix)
- libqrencode (no upstream URL serves 4.1.1's release tarball any more)
- openal (Fedora repacks openal-soft by hand; no upstream serves those bytes)
- libcaca (would need libcaca, slang, freeglut)
- dc1394, which also covers libiec61883 (libdc1394, libiec61883,
  libavc1394, libraw1394)
- libklvanc

Stages sit one above each recipe's highest factory BuildRequires:
libunibreak, libmysofa, zimg, tinyxml2, openpgm and poppler-data at 0;
libass, libbs2b, vid.stab, libsamplerate and osinfo-db-tools at 1;
rubberband and osinfo-db at 2. libosinfo BuildRequires osinfo-db, so it
moves from 0 to 3. ffmpeg stays at 3, above all its new inputs, so nothing
that consumes it has to move.

The recipe set grows from 373 to 386, so update the count assertions and
docs/architecture.md.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01QMTLsnqW2jtz5QsNC3W3qv
@hanthor
hanthor merged commit b92a400 into main Sep 25, 2026
3 checks passed
hanthor added a commit that referenced this pull request Sep 26, 2026
#269)

Utah's image build installs from the published factory repository plus
Hummingbird, and Fedora is not visible there. Two factory recipes had been
resolving runtime dependencies from Fedora 44 in the build root:

- libgphoto2 links libexif.so.12 and liblockdev.so.1
- libppd Requires ghostscript >= 10.0.0 (libcupsfilters also links
  libexif.so.12 and BuildRequires ghostscript)

Import the Fedora Rawhide recipes for libexif (0.6.26) and ghostscript
(10.08.0). Each Source0 is the upstream GitHub release, whose bytes match the
SHA-512 in the imported `sources` file; the Fedora lookaside is a fallback
only.

lockdev is not imported. Fedora builds a 2011 alioth nightly snapshot pinned
by MD5 only; alioth is gone, Debian dropped lockdev after jessie at 1.0.3, and
no upstream serves those bytes. As ffmpeg did for libqrencode and openal
(#249), libgphoto2 drops lockdev-devel and configures with --disable-lockdev
--disable-ttylock. lockdev only locks legacy RS-232 camera ports.

Trim ghostscript so libgs's runtime closure is Hummingbird plus the factory
(lcms2, openjpeg). New bconds, each explained in the spec:

- system_resources 0: ship the Resource/ fonts, CMaps and DroidSansFallback
  from the tarball instead of symlinking to (and Requiring)
  urw-base35-fonts, adobe-mappings-cmap/-pdf and google-droid-sans-fonts,
  none of which is in Hummingbird. License gains Apache-2.0, BSD-3-Clause
  and MIT for the bundled files.
- system_jbig2dec_ijs 0: build the bundled jbig2dec and ijs; libjbig2dec and
  libijs are in neither repository. JBIG2 and the ijs device still work.
- libpaper 0 (--without-libpaper): libpaper.so.2 is in neither repository,
  and CUPS passes the page size explicitly.
- gtk 0 / x11 0 (--disable-gtk --without-x): the gsx viewer and X11
  devices are unused, and they would put ghostscript, libppd and
  cups-filters behind gtk3 and libXt in the build order.
- dvipdf 0: ghostscript-tools-dvipdf Requires texlive-dvips.

The cups raster device, gs, libgs, fontutils, printing tools and docs stay.

Stages: libexif 0; ghostscript 1 (git, lcms2, openjpeg). libgphoto2 now
BuildRequires a factory libexif, so it gets stage 1 (gvfs stays at 3).
libcupsfilters BuildRequires ghostscript and libexif, so it moves 0 -> 2,
libppd 1 -> 3, and cups-filters and cups-browsed 2 -> 4.

The recipe set grows from 397 to 399, so update the count assertions and
docs/architecture.md, and record the printing closure in
docs/skills/repeated-mistakes.md.


Claude-Session: https://claude.ai/code/session_01QMTLsnqW2jtz5QsNC3W3qv

Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant