BAL cache lineage (PR #6 of the perf stack)#20893

Closed

mh0lt wants to merge 126 commits into

mainfrom

fix/eth71-multiclient-server-dispatch

Commits on May 21, 2026

commitment: extract canonical DecodeBranchInto from unfoldBranchNode

Mark Holt
and
claude
committed
commitment: add BranchCache with pinned root + bounded LRU tail

Mark Holt
and
claude
committed
commitment: document BranchCache concurrency contract

Mark Holt
and
claude
committed
commitment: wire BranchCache into trie read + encoder write paths

Mark Holt
and
claude
committed
commitment, db/state: lift BranchCache lifetime to aggregator scope
Mark Holt
committed
commitment: BranchCache divergence detector + per-block fingerprint log
Mark Holt
committed
commitment: disable deferred-encoding mode (use inline CollectUpdate)
Mark Holt
committed
commitment: add DISABLE_BRANCH_CACHE_READS env kill-switch
Mark Holt
committed
commitment: multi-layer state probe at BranchCache divergence site
Mark Holt
committed
commitment: tag BranchCache writes with origin + write-seq + timestamp
Mark Holt
committed

Commits on May 22, 2026

commitment, db/state/execctx: move BranchCache behind sd.mem chain

Mark Holt
and
claude
committed
commitment/branch_cache: document responsibility split + post-WarmupCache state
Mark Holt
committed
commitment/branch_cache: add pinned tier (PinEntry / PinnedCount)
Mark Holt
committed
commitment/preload: PreloadContractTrunk recursive enumeration
Mark Holt
committed
state/execctx, commitment: PIN_CONTRACT_TRUNKS env hook
Mark Holt
committed
state/execctx: trunk-preload sync (was async, hit cgo-pointer panic)
Mark Holt
committed
commitment, state/execctx: trunk-preload progress logs + max-branches cap
Mark Holt
committed
state/execctx: run trunk-preload AFTER SeekCommitment
Mark Holt
committed
state/execctx: trunk-preload async with own tx, triggered from EnableParaTrieDB
Mark Holt
committed
execution/commitment: PIN_TRUNK_MAX_DEPTH env + raise maxBranches cap
Mark Holt
committed
stagedsync/exec3_parallel: re-enable trie warmup on parallel path

Mark Holt
and
claude
committed
commitment: WarmupCache hit/miss/evict observability counters

Mark Holt
and
claude
committed
commitment: extract unfoldKeyPath as per-key traversal primitive

Mark Holt
and
claude
committed
commitment: WarmupCache dirty-flag + PutBranchIfClean invariants

Mark Holt
and
claude
committed
commitment: WarmupCache GetBranchDecoded — lazy-decode read path

Mark Holt
and
claude
committed
execmodule: chain ValidateChain SD to currentContext for head-extending payloads
Mark Holt
committed
db/state: H0 baseline benchmark for snapshot-vs-MDBX read cost

Mark Holt
and
claude
committed
db/state: H0 real-datadir bootstrap; first production numbers

Mark Holt
and
claude
committed
db/state, commitment: H_GetAsOf bench + per-block calculator timing

Mark Holt
and
claude
committed
commitment: surface per-block telemetry on cache-fp log

Mark Holt
and
claude
committed
stagedsync/calc_state: skip wasted ensureStorage in StoragePath ApplyWrites

Mark Holt
and
claude
committed
commitment: split disk-load counter from EVM-write plumbing
Mark Holt
committed
state, commitment: scaffold to quantify EIP-684 HasPrefix cost on snapshot storage
Mark Holt
committed
commitment, dbg: warmer scales 1:1 with cores; document pooling strategy
Mark Holt
committed
existence, state, commitment: add measurement counters for assumption check
Mark Holt
committed
commitment/warmuper: stop walking past leaf cells
Mark Holt
committed
commitment: drop BranchEncoder's WarmupCache fast path
Mark Holt
committed
commitment/hph: drop hph.cache (WarmupCache read-through layer)
Mark Holt
committed
commitment, db/state, stagedsync: delete WarmupCache type and toggle chain
Mark Holt
committed
commitment: mark BranchCache dirty in CollectDeferredUpdate too
Mark Holt
committed
commitment/warmuper: scope warmer to branches only — drop account/storage prefetch
Mark Holt
committed
state, commitment: add unique-prefix file-read counter
Mark Holt
committed
state, commitment: add unique-prefix length histogram
Mark Holt
committed
state, commitment: refine length histogram inside storage subtree
Mark Holt
committed
state/changeset: trunk-probe log to identify hot contracts
Mark Holt
committed
commitment: surface pinned-tier counters on cache-fp log
Mark Holt
committed
db/state, db/kv: add TemporalMemBatch.FlushWithCallback
Mark Holt
committed
commitment, state/execctx: BFS / budget-driven trunk preload
Mark Holt
committed
state/execctx: raise PIN_TRUNK_RAM_BUDGET_MB default 32 → 64
Mark Holt
committed
state/execctx: clamp PIN_TRUNK_RAM_BUDGET_MB at 64 MiB per contract
Mark Holt
committed
commitment/branch_cache: pin-aware Invalidate, GetWithOrigin, Clear
Mark Holt
committed
state/execctx: invalidate stale BranchCache entries on SD.Unwind
Mark Holt
committed
commitment/preload: split BFS into resumable ContractTrunkPreload
Mark Holt
committed
commitment/branch_cache: add miss-callback hook for adaptive controller
Mark Holt
committed
commitment: AdaptivePinController for promotion / extension / demotion
Mark Holt
committed
state/execctx: wire AdaptivePinController into SharedDomains
Mark Holt
committed
commitment: Prometheus metrics for trunk-pin layer
Mark Holt
committed
commitment: tests for trunk-pin layer + delete orphaned warmup test
Mark Holt
committed
commitment, db/state: drop bench-only env knobs and cache-fp log
Mark Holt
committed
lint: gofmt fixes + drop snapshot_vs_mdbx bench test
Mark Holt
committed
perf(r3): bulk storage-trunk preload via two-parity range scan (core + tests)

Mark Holt
and
claude
committed
perf(r3): wire triggerTrunkPreload to the bulk range-scan path

Mark Holt
and
claude
committed
perf(r3): adaptive controller uses LoadBulk (range scan) when available

Mark Holt
and
claude
committed
perf(preload): retire the broken R3 range-scan preload

Mark Holt
and
claude
committed
perf(preload): parallel file-only wave-BFS preload (cut-down)

Mark Holt
and
claude
committed
perf(preload): cap per-wave fetch by remaining budget

Mark Holt
and
claude
committed
perf(preload): phase 1 — MDBX-resident branch prefetch (operational correctness)

Mark Holt
and
claude
committed
db/state: test for the phase-1 dbPrefetch cursor walk

Mark Holt
and
claude
committed
commitment, db/state: resumable parallel preload + adaptive parallel-mode wiring

Mark Holt
and
claude
committed
execution/commitment: keep the trie checkpoint key out of BranchCache

Mark Holt
and
claude
committed
execution: parent fork-validation SD into the canonical generation

Mark Holt
and
claude
committed
execution/commitment: prealloc rest slice in preload_parallel

Mark Holt
and
claude
committed
db/state/execctx, execution/execmodule: clear BranchCache on SetHead unwind

Mark Holt
and
claude
committed

Commits on May 23, 2026

Merge remote-tracking branch 'origin/main' into mh/perf-caches-pr
Mark Holt
committed
execution/stagedsync/rawdbreset: clear branchCache on ResetExec (#21138)

Mark Holt
and
claude
committed
common/dbg, node/ethconfig: default ExecWorkerCount = NumCPU-1

Mark Holt
and
claude
committed
Revert "common/dbg, node/ethconfig: default ExecWorkerCount = NumCPU-1"
Mark Holt
committed

Commits on May 25, 2026

Commits on May 26, 2026

Commits on May 27, 2026

Commits on Jun 4, 2026

db/state/execctx: decode AccountsDomain codeHash with DeserialiseV3

mh0lt
and
claude
committed

Commits on Jun 5, 2026

Commits on Jun 7, 2026

Commits on Jun 8, 2026