Skip to content

feat(performance): expose cached V8 memory snapshots - #444

Merged
ldm0 merged 1 commit into
mainfrom
wpt/performance-memory
Sep 8, 2026
Merged

feat(performance): expose cached V8 memory snapshots#444
ldm0 merged 1 commit into
mainfrom
wpt/performance-memory

Conversation

@ldm0

@ldm0 ldm0 commented Sep 8, 2026

Copy link
Copy Markdown
Member

No description provided.

@github-actions

github-actions Bot commented Sep 8, 2026

Copy link
Copy Markdown

Spider Bench A/B

✅ All benchmark browser service runs completed; results are informational.

Public HEAD: 184 / 240 rows; 38 / 48 sites produced rows; 10 unexpected empty sites.

✅ Deterministic fixture contract is clean.

Common ancestor 4c00e6dab6ae → HEAD a4174af1b6cc; benchmark order: head-first; workflow: success.

Public 48-site run · informational

Metric Base HEAD Δ
Run status success success —
Extracted rows / contract 184 / 240 184 / 240 0 (0.00%)
Contract fill 76.67% 76.67% 0.00 pp (0.00%)
Sites with rows 38 / 48 38 / 48 0 (0.00%)
Sites meeting row contract 36 / 48 36 / 48 0 (0.00%)
Unexpected empty sites 10 10 0 (0.00%)
Partial-row sites 2 2 0 (0.00%)
Site outcomes extracted: 36; HTTP error + rows: 2; empty: 7; HTTP error + empty: 1; snapshot error + empty: 2 extracted: 37; HTTP error + rows: 1; empty: 7; HTTP error + empty: 1; snapshot error + empty: 2 —
Observed duration 49.25 s 43.24 s -6.02 s (-12.22%)
Estimated CPU 47.20 s 45.22 s -1.99 s (-4.21%)
Peak PSS 247.28 MiB 214.46 MiB -32.82 MiB (-13.27%)
Peak RSS 252.33 MiB 217.81 MiB -34.52 MiB (-13.68%)
Peak threads 27 27 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0
Category rows Base HEAD Δ
news 35 / 40 35 / 40 0
stocks 20 / 40 20 / 40 0
tech 35 / 40 35 / 40 0
sports 27 / 40 27 / 40 0
games 37 / 40 37 / 40 0
life 30 / 40 30 / 40 0

Public-site content, timing, and memory are noisy. This single A/B run reports evidence only; site outcome counts explain missing rows without treating them as a deterministic regression.

CPU and memory timelines

These are bounded 40-point views of the same complete process-tree samples used by the HTML report. CPU uses 100% per occupied logical core; memory lines are RSS first and PSS second when complete PSS samples are available.

Base

xychart-beta
    title "Base CPU"
    x-axis "Elapsed seconds" [1.536, 2.537, 3.038, 4.039, 5.04, 5.541, 7.044, 8.545, 9.546, 11.048, 12.55, 14.053, 15.054, 16.556, 18.058, 19.562, 20.562, 22.065, 23.569, 25.07, 26.072, 27.573, 29.074, 30.576, 31.577, 33.078, 34.582, 36.083, 37.084, 38.586, 39.087, 40.088, 41.589, 42.59, 44.091, 45.593, 47.095, 48.095]
    y-axis "CPU percent" 0 --> 500
    line [115.85, 120, 123.85, 113.81, 241.85, 213.67, 159.58, 159.84, 155.84, 147.79, 127.84, 115.78, 67.96, 0, 27.94, 53.86, 47.98, 0, 61.84, 73.82, 111.94, 109.87, 113.93, 111.9, 101.94, 121.81, 67.84, 47.87, 23.98, 127.86, 145.77, 143.95, 19.98, 13.98, 105.71, 189.85, 107.72, 114.08]
Loading 
xychart-beta
    title "Base memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.034, 1.536, 2.537, 3.038, 4.039, 5.04, 5.541, 7.044, 8.545, 9.546, 11.048, 12.55, 14.053, 15.054, 16.556, 18.058, 19.562, 20.562, 22.065, 23.569, 25.07, 26.072, 27.573, 29.074, 30.576, 31.577, 33.078, 34.582, 36.083, 37.084, 38.586, 39.087, 40.088, 41.589, 42.59, 44.091, 45.593, 47.095, 48.095, 49.254]
    y-axis "Memory MiB" 0 --> 500
    line [12.34, 106.29, 113.33, 132.25, 135.33, 176.71, 169.07, 178.43, 162.77, 180.51, 173.7, 183.37, 174.94, 168.59, 147.5, 144.56, 149.27, 148.33, 140.41, 141.66, 156.65, 153.88, 201.77, 169.3, 169.16, 177.52, 151.96, 150.08, 153.89, 153, 229.3, 252.33, 183.74, 159.61, 150.37, 167.47, 166.82, 163.37, 175.12, 0]
    line [9.26, 102.88, 109.83, 128.73, 132.16, 173.15, 165.51, 174.99, 159.26, 176.92, 170.2, 179.86, 171.49, 165.08, 143.99, 141.15, 145.77, 144.84, 136.97, 138.04, 153.01, 151.31, 202.85, 165.66, 165.53, 173.92, 148.37, 146.45, 150.25, 149.35, 225.73, 247.28, 181.82, 155.97, 146.73, 163.83, 160.91, 160.16, 172.01, 0]
Loading

HEAD

xychart-beta
    title "HEAD CPU"
    x-axis "Elapsed seconds" [1.035, 2.036, 2.537, 3.538, 5.04, 5.541, 6.041, 7.542, 8.543, 9.545, 11.047, 12.048, 13.549, 14.549, 15.551, 17.054, 18.056, 19.558, 20.559, 22.06, 23.061, 24.062, 24.562, 25.562, 26.564, 28.065, 29.066, 30.067, 31.571, 32.571, 34.073, 35.073, 36.576, 37.578, 38.579, 40.082, 41.082, 42.583]
    y-axis "CPU percent" 0 --> 500
    line [27.99, 89.85, 115.77, 142.04, 197.46, 283.81, 185.95, 176, 117.67, 163.71, 133.66, 129.86, 132.07, 125.94, 87.8, 111.75, 25.94, 144.01, 85.81, 115.94, 137.81, 132.04, 104.03, 133.88, 115.95, 109.85, 89.92, 23.95, 111.73, 9.99, 127.91, 91.89, 4, 2, 129.82, 179.81, 51.95, 151.84]
Loading 
xychart-beta
    title "HEAD memory: RSS then PSS"
    x-axis "Elapsed seconds" [0.035, 1.035, 2.036, 2.537, 3.538, 5.04, 5.541, 6.041, 7.542, 8.543, 9.545, 11.047, 12.048, 13.549, 14.549, 15.551, 17.054, 18.056, 19.558, 20.559, 22.06, 23.061, 24.062, 24.562, 25.562, 26.564, 28.065, 29.066, 30.067, 31.571, 32.571, 34.073, 35.073, 36.576, 37.578, 38.579, 40.082, 41.082, 42.583, 43.237]
    y-axis "Memory MiB" 0 --> 500
    line [12.3, 86.35, 109.38, 118.57, 133.51, 182.14, 167.28, 162.97, 176.73, 157.46, 191.41, 164.91, 180.41, 176.34, 159.09, 160.8, 152.37, 142.15, 175.65, 164.31, 163.82, 180.52, 188.48, 217.81, 159.07, 156.75, 173.46, 147.04, 146.7, 155.46, 161.64, 209.46, 182.78, 165.75, 159.81, 211.17, 169.99, 157.17, 191.88, 0]
    line [8.99, 82.72, 105.79, 115.02, 129.93, 178.91, 163.91, 159.62, 173.38, 154.17, 187.89, 161.37, 176.99, 173.01, 155.17, 157.26, 148.85, 138.7, 172.06, 160.8, 159.67, 177.17, 185.1, 214.46, 155.76, 153.33, 169.99, 143.6, 143.26, 152.1, 158.21, 205.94, 179.49, 162.33, 156.5, 208.77, 166.59, 153.87, 188.5, 0]
Loading

Deterministic fixture · required contract

The fixture exercises 15 routes: 8 are expected to emit rows and 7 intentionally exercise empty, loading, or timeout behavior.

Metric Base HEAD Δ
Run status success success —
Extracted rows / contract 40 / 40 40 / 40 0 (0.00%)
Contract fill 100.00% 100.00% 0.00 pp (0.00%)
Sites with rows 8 / 15 8 / 15 0 (0.00%)
Sites meeting row contract 15 / 15 15 / 15 0 (0.00%)
Unexpected empty sites 0 0 0
Partial-row sites 0 0 0
Site outcomes extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 extracted: 7; HTTP error + rows: 1; empty: 3; timeout + empty: 4 —
Observed duration 19.88 s 19.88 s -0.01 s (-0.03%)
Estimated CPU 0.43 s 0.43 s 0.00 s (0.00%)
Peak PSS 57.43 MiB 57.30 MiB -0.13 MiB (-0.22%)
Peak RSS 61.05 MiB 60.89 MiB -0.16 MiB (-0.27%)
Peak threads 18 18 0 (0.00%)
Mismatched sites 0 0 0
Timeout with items 0 0 0

Full HTML, JSON, CSV, logs, and page snapshots: workflow run and full spider-bench-results artifact.

The public-web A/B is informational. The exact HEAD fixture contract runs as a separate required CI check; timing and public-site content deltas remain non-blocking.

@github-actions

github-actions Bot commented Sep 8, 2026

Copy link
Copy Markdown

Sequential Navigation Soak A/B

✅ HEAD completed the 200-navigation resilience and memory observation.

One browser process, one target, and one CDP session navigate CSDN → SegmentFault → Huaban → example.com repeatedly. This run issued 200 Page.navigate commands per binary.

Common ancestor 4c00e6dab6 → HEAD a4174af1b6; benchmark order: head-first; workflow: success.

Session resilience

Metric Base HEAD
Attempted / planned 200 / 200 200 / 200
Direct observable pass 200 / 200 200 / 200
Failures / recovered 0 / 0 0 / 0
Recovery failures 0 0
Lifecycle order violations 0 0
Network order violations 0 0
Wall time 263.8 s 264.8 s

A public-page failure is reported separately from an unrecoverable session. The soak requires all navigation attempts, zero failed recovery, zero lifecycle/network ordering violations, and complete resource evidence.

Process-tree memory

Metric Base HEAD Δ
Boundary samples 200 200 0
Boundary RSS samples 200 200 0
Boundary PSS samples 200 200 0
Periodic peak RSS 212.1 MiB 214.7 MiB +2.6 MiB
Periodic peak PSS 208.8 MiB 211.0 MiB +2.1 MiB
RSS · first 10 avg 145.6 MiB 158.0 MiB +12.4 MiB
RSS · last 10 avg 157.5 MiB 156.8 MiB -0.7 MiB
RSS · last − first window +11.9 MiB -1.2 MiB -13.1 MiB
RSS · warm slope / 100 nav +0.6 MiB -1.5 MiB -2.0 MiB
PSS · first 10 avg 142.3 MiB 154.3 MiB +12.0 MiB
PSS · last 10 avg 154.2 MiB 153.4 MiB -0.8 MiB
PSS · last − first window +11.9 MiB -0.9 MiB -12.7 MiB
PSS · warm slope / 100 nav +0.6 MiB -1.6 MiB -2.2 MiB
Peak file descriptors 61 60 -1
Peak threads 31 31 0

HEAD memory by 50-navigation quarter

HEAD range Avg RSS Final RSS Peak RSS Avg PSS Final PSS Peak FD
1–50 159.8 MiB 147.4 MiB 215.6 MiB 156.2 MiB 144.1 MiB 51
51–100 160.5 MiB 142.7 MiB 208.7 MiB 157.0 MiB 139.1 MiB 49
101–150 159.7 MiB 151.4 MiB 199.5 MiB 156.1 MiB 147.7 MiB 51
151–200 158.9 MiB 142.2 MiB 198.8 MiB 155.3 MiB 138.8 MiB 52

Raw reports and per-navigation boundary samples: workflow run and full sequential-navigation-soak-results artifact.

Public-site timing and memory are observational. Use the A/B deltas and trend shape as evidence, not as a deterministic performance threshold.

@github-actions

github-actions Bot commented Sep 8, 2026

Copy link
Copy Markdown

CI Regression Report

Source CI run · source state at render: in_progress · artifacts: 5/5

Check Status Signal
Release regression ✅ HEAD/base failures 0/0; raw binary +0.003223%
Frontend differential ❌ 1,019/1,020 cases matched; 1 issues
Agent episodes ✅ 8/8 Moli episodes passed; 0 failures
Runtime/CDP contracts ✅ 26 contract cases; 0 failures
CDP smoke ✅ 44/44 groups passed; 457 scenarios
Release regression — ✅ HEAD/base failures 0/0; raw binary +0.003223%

Package and image size

Metric Base HEAD Delta Delta %
Raw binary 149.13 MiB 149.14 MiB +4.92 KiB +0.003223%
Stripped binary 103.39 MiB 103.39 MiB +4.00 KiB +0.003778%
gzip binary 50.17 MiB 50.17 MiB −183 B −0.000348%
Rootfs 156.04 MiB 156.04 MiB 0 B 0.00%
gzip rootfs 58.99 MiB 58.99 MiB +2.71 KiB +0.004485%

Startup latency and PSS

Case Base p50 HEAD p50 Delta Base PSS HEAD PSS Delta
Serve ready 27.16 ms 27.33 ms +0.17 ms 3.73 MiB 4.72 MiB +1016.50 KiB
CDP first page 50.58 ms 50.83 ms +0.25 ms 3.65 MiB 4.13 MiB +494.50 KiB
CDP warm page 13.14 ms 13.26 ms +0.12 ms 48.45 MiB 49.33 MiB +900.00 KiB
CLI about:blank 14.22 ms 13.96 ms −0.26 ms 2.55 MiB 2.91 MiB +373.00 KiB
CLI local JS 17.65 ms 18.19 ms +0.53 ms 3.46 MiB 3.20 MiB −268.00 KiB

Concurrency matrix

Concurrency Base p50 HEAD p50 Delta Base PSS HEAD PSS Delta HEAD failures Unstable B/H
1 17.02 ms 17.71 ms +0.69 ms 610.00 KiB 601.00 KiB −9.00 KiB 0 0/0
5 20.53 ms 21.65 ms +1.12 ms 12.31 MiB 12.51 MiB +196.50 KiB 0 0/0
10 21.73 ms 20.35 ms −1.38 ms 17.54 MiB 12.14 MiB −5.40 MiB 0 0/0
25 20.70 ms 20.20 ms −0.50 ms 25.28 MiB 9.59 MiB −15.69 MiB 0 0/0
100 20.87 ms 19.95 ms −0.92 ms 11.79 MiB 26.94 MiB +15.15 MiB 0 0/0
Frontend differential — ❌ 1,019/1,020 cases matched; 1 issues
Match DOM mismatch Diagnostic mismatch Moli error Reference error Infrastructure error Mismatched frames Duration
0 0 0 0 1 0 0 3m 15.75s

First failing cases

  • react/script-module-lifecycle/import-map-bare-specifier — reference_error · Chromium error fixture emitted browser diagnostics: {"exceptions":[],"consoleErrors":[],"networkFailures":[{"requestId":"3D644070245FDCE142026876A630A249","url":null,"errorTex
Agent episodes · Moli vs Chromium — ✅ 8/8 Moli episodes passed; 0 failures
Fast contract Episodes Passed Assertions Ready p50 Episode p50
Moli 8 8 47/47 3.95 ms 24.40 ms
Chromium 8 8 47/47 210.41 ms 84.48 ms
Operation p50 Chromium Moli Delta Delta %
navigate 41.52 ms 6.47 ms −35.06 ms −84.42%
observe 0.91 ms 0.81 ms −0.10 ms −11.25%
fill 2.79 ms 2.94 ms +0.16 ms +5.57%
click 5.60 ms 3.54 ms −2.06 ms −36.78%
Idle-resource episode Peak RSS Peak PSS Average CPU Peak CPU Peak processes Sampler
Moli 63.38 MiB 60.53 MiB 0.65% 10.00% 1 ✅
Chromium 1308.07 MiB 351.69 MiB 2.28% 91.91% 13 ⚠️ PSS partial
Runtime and CDP session contracts — ✅ 26 contract cases; 0 failures
Suite Cases Failures Median case p50 Median case p95 Median peak PSS p50
Synthetic fetch 13 0 16.94 ms 17.36 ms 777.00 KiB
Long-lived CDP session 13 0 18.45 ms 19.02 ms —
CDP smoke — ✅ 44/44 groups passed; 457 scenarios

Workers: 4 · cumulative group time: 109.87 s · failed groups: 0

Slowest group Scenarios Duration Status
chromium-cdp 56 10.96 s ✅
dom-input 26 9.35 s ✅
multi-page 45 9.22 s ✅
layout-screenshot 5 6.95 s ✅
core 35 6.00 s ✅

All artifact fields are parsed by the trusted default-branch renderer; missing or invalid inputs remain visible as unavailable.

@ldm0
ldm0 merged commit 761e9d0 into main Sep 8, 2026
33 of 34 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@ldm0