Skip to content

feat(arc): persistent /cache volume for unprivileged job containers - #4586

Merged
dapperdivers merged 1 commit into
mainfrom
feat/arc-unprivileged-cache
Nov 5, 2026
Merged

dapperdivers merged 1 commit into
mainfrom
feat/arc-unprivileged-cache

Conversation

@dapperdivers

Copy link
Copy Markdown
Owner

Summary

Adds a persistent /cache volume (RWX cephfs PVC dapper-cluster-unprivileged-cache, 20Gi) to every job-container pod on the unprivileged runner set, through the hook template. It also sets pod fsGroup: 1001 (OnRootMismatch) so the uid-1001 job can write to it.

Why

In-cluster Renovate (dry run 41946456740) took 348s versus 132–152s on ubuntu-latest. Every phase was network-bound, because each run starts cold over the home WAN:

Phase In-cluster (cold) GitHub-hosted
clone + extract 34s 14s
lookups 83s 43s
update (branch work + tool downloads) 223s 36s

With state kept in /cache, Renovate (#4585) can persist its clone (persistRepoData), repository cache, package cache and containerbase tool downloads. Later runs then fetch only deltas. GitHub-hosted runners can never stay warm like that.

Only affects job pods on dapper-cluster-unprivileged (Renovate, still on a test branch). Workflows use their own subdirectory, e.g. /cache/renovate.

Validation

  • flate test all: 298 passed
  • After merge: dispatch two dry runs from ci/renovate-unprivileged-runner (cold, then warm) and compare timings

Renovate on the in-cluster runner was ~2.5x slower than GitHub-hosted
(348s vs 132-152s) because every run started cold over the WAN: fresh
clone, tool downloads, all registry lookups. Mount an RWX cephfs PVC at
/cache in every job-container pod (hook template) with fsGroup 1001 so it
is writable, letting workflows keep state between runs.
@dapperdivers
dapperdivers merged commit 4342369 into main Nov 5, 2026
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant