Skip to content

feat: faster emulated builds #37

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
lczyk merged 4 commits into from
Sep 12, 2026
Merged

feat: faster emulated builds #37

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
cefac94
fix(ci)?: bust image cache on tar-shim change
lczyk Sep 12, 2026
759e937
ci?: parallel image bakes
lczyk Sep 12, 2026
c797c05
ci?: ungate qemu image builds from tests
lczyk Sep 12, 2026
cfd5adb
ci?: cap parallel bakes at 2
lczyk Sep 12, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 5 additions & 2 deletions .github/workflows/build-oci.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -60,15 +60,18 @@ jobs:
uses: actions/cache@55cc8345863c7cc4c66a329aec7e433d2d1c52a9 # v6.1.0
with:
path: images-out/
key: images-${{ matrix.arch }}-${{ hashFiles('images/Dockerfile.*', 'hack/bread-warning.sh', 'hack/banner.txt', 'hack/lazy-apt.sh', 'hack/apt-mirror.sh', 'hack/build_image.sh', format('.stamp/binaries-{0}', matrix.arch)) }}
key: images-${{ matrix.arch }}-${{ hashFiles('images/Dockerfile.*', 'hack/bread-warning.sh', 'hack/banner.txt', 'hack/tar-shim.sh', 'hack/lazy-apt.sh', 'hack/apt-mirror.sh', 'hack/build_image.sh', format('.stamp/binaries-{0}', matrix.arch)) }}

- name: Set up qemu (emulated arches only)
if: matrix.qemu && steps.images-cache.outputs.cache-hit != 'true'
uses: docker/setup-qemu-action@1f40c72289eff860ee54a304f1438e3cff362e0a # v4.3.0

# Emulated builds are ~single-core and the per-version chains are
# independent, so run them in parallel. Past 2 they only contend for
# the runner's cores. -O keeps each image's log whole.
- name: Bake bread + bread-chisel-releases images for ${{ matrix.arch }}
if: steps.images-cache.outputs.cache-hit != 'true'
run: make build-bread build-bread-chisel-releases ARCH=${{ matrix.arch }}
run: make -j2 -O build-bread build-bread-chisel-releases ARCH=${{ matrix.arch }}

- name: Save images as docker-archive tarballs
if: steps.images-cache.outputs.cache-hit != 'true'
Expand Down
20 changes: 17 additions & 3 deletions .github/workflows/release.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -24,20 +24,34 @@ jobs:
needs: binaries
uses: ./.github/workflows/build-and-test.yaml

build-oci:
build-oci-native:
needs: [binaries, build-and-test]
uses: ./.github/workflows/build-oci.yaml
with:
matrix: >-
[{"runner": "ubuntu-24.04", "arch": "amd64"},
{"runner": "ubuntu-24.04-arm", "arch": "arm64"}]

# qemu lanes publish untested, so they skip the build-and-test gate and
# overlap with it. Publishing still waits on the gated native lanes.
build-oci-qemu:
needs: binaries
uses: ./.github/workflows/build-oci.yaml
with:
matrix: >-
[{"runner": "ubuntu-24.04", "arch": "s390x", "qemu": true},
{"runner": "ubuntu-24.04", "arch": "ppc64le", "qemu": true}]

push-ghcr:
needs: build-oci
needs: [build-oci-native, build-oci-qemu]
uses: ./.github/workflows/push-ghcr.yaml
permissions:
contents: read
packages: write
id-token: write

publish-release:
needs: [binaries, build-oci]
needs: [binaries, build-oci-native, build-oci-qemu]
runs-on: ubuntu-24.04
timeout-minutes: 10
permissions:
Expand Down