You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
ci: label PRs by size without counting tests - #1419
Every PR gets one size:XS .. size:XXL label (<10, <30, <100, <500, <1000, 1000+ lines), updated on each push. Lets reviewers see how big a PR is from the PR list.
Counts added plus deleted lines from the PR's file list, without *.test.*, *.spec.*, *.e2e.*, tests/, tests-*/, __tests__/, *-snapshots/, __snapshots__/, fixtures/, pnpm-lock.yaml. A PR touching only those is sized by all its lines.
Same shape as pr-policy: pull_request_target so fork PRs can be labeled, sparse checkout of the base branch's scripts/pr-size only, fetch with GITHUB_TOKEN. Never checks out or runs PR code. --dry-run prints the size and writes nothing.
Rules in scripts/pr-size/size.ts, API calls in scripts/pr-size/label.ts. Labels get created with colors the first time they're used.
Idea from T3 Code's pr-size.yml.
Verified
Ran it locally: yes
node scripts/pr-size/label.ts --dry-run against the last 10 PRs here:
The workflow itself has not run. pull_request_target uses the base branch copy, so it starts working after merge and won't label this PR.
Checklist
Changeset added (pnpm changeset) for any change to a published package, or the change is testbed, docs, or CI only.
Breaking change: title carries !, the changeset body names what breaks and what replaces it, and the deprecation warning landed a window earlier (stability policy in CONTRIBUTING.md).
Docs updated in the same PR: the docs/**/*.mdx page for the behavior, and skills/e2e/ if the skill describes it.
Contract change: emitted .d.ts reviewed, tests/types/sdk-types.ts updated; wire change edits the schema and both fixtures.
Engine contract change (e2e/engine): changesets for e2e, @e2e-dev/web, and @e2e-dev/mobile.
ASSERTION_FAILED at step 4 of 4: agent.act "Complete this scenario as the screen instructs: wait for the screen to load, scroll up on the reward area to refresh it, then claim the reward", after 1m 34s and 24 model calls
agent.act failed: Waited for loading to finish, pulled down on the reward area until the Claim reward button appeared, and tapped it. The latest screen still shows “Claiming reward…” with no completed-claim confirmation, so the reward outcome was not verified.
Turn 21: swipe({"from":{"x":172,"y":300},"to":{"x":172,"y":650}}) → [swipe] Swiped from (172, 300) to (172, 650).
Turn 22: screenshot({}) → [screenshot] The screen changed substantially since revision b24. Current screen (revision b26, path dev.e2e.benchmark, 21 nodes):
control inventory › a label query resolves a labeled text field
12.4s
🟢
control inventory › a labeled field answers name, display value, value reads, fill, and clear
14.7s
🟢
control inventory › a placeholder query and attribute reads find the field
4.5s
🟢
control inventory › a secure field takes a fill and denies value reads
9.1s
🟢
control inventory › press sends a character and Enter through the soft keyboard
8.5s
🟢
control inventory › a field autofocuses on mount and focus() moves the focus
10.5s
🟢
control inventory › toBeFocused follows the focus
9.5s
🟢
control inventory › a switch checks, unchecks, and reports its state
10.2s
🟢
control inventory › checkbox and radio roles answer getByRole, and a checkbox toggles by tap
8.8s
🟢
control inventory › checkbox and radio roles check, uncheck, and report their state
13.0s
🟢
control inventory › a radio group reports the checked option
9.3s
🟢
control inventory › buttons report disabled, enabled, and a state that arrives later
9.2s
🟢
control inventory › a display: none element is absent rather than hidden, its visible twin attached
7.9s
🟢
control inventory › a header answers its accessible name
5.3s
🟢
control inventory › a tab row answers count, all, texts, filters, positions, and switching
7.0s
🟢
control inventory › a list answers counts, list-form text, reads, and boxes in order
7.4s
⏭️
control inventory › a row contains its texts (skipped: React Native flattens a plain View out of the accessibility tree on both platforms: XCTest and the Android helper report a View with a testID as a leaf beside its children, so filter({ has }) and a query scoped to it match nothing; only Sc…)
🟢
control inventory › a long press lands as one
9.0s
🟢
control inventory › pointer verbs land at the point asked for
10.4s
🟢
control inventory › an ambiguous locator fails at once
6.1s
🟢
control inventory › screenshot, restart, and clearState reopen the app on its home list
14.0s
🟢
refusals › verbs a device never declares are refused before the engine
2ms
🟢
refusals › keys the soft keyboard cannot send are refused by the engine
494ms
🟢
refusals › a missing locator fails as not found once its timeout passes
1.1s
🟢
tests/device-fixture.e2e.ts · 10 passed
1m 25s
🟢
device fixture › setAppearance flips the color scheme the app reads
12.5s
🟢
device fixture › setOrientation rotates the window the app measures
7.5s
🟢
device fixture › the clipboard reads back what was written
5.7s
🟢
device fixture › home leaves the app, openApp brings it back where it was
5.9s
🟢
device fixture › closeApp then openApp relaunches on the home list
8.2s
🟢
device fixture › closeApp leaves the next commands on the same device
9.9s
🟢
device fixture › foregroundApp after closeApp reports the closed session as APP_NOT_OPEN
6.7s
🟢
device fixture › device.back pops the scenario
6.1s
🟢
device fixture › setLocation and clearLocation change what the app reads
11.6s
🟢
device fixture › enrollBiometrics and setBiometrics answer a biometric prompt
10.8s
🟢
tests/device.e2e.ts · 3 passed
1m 10s
🟢
sequential onboarding echoes the exact values
42.2s
🟢
onboarding rejects a malformed email before advancing
15.1s
🟢
dismissing the keyboard over choice controls leaves them as they were
13.0s
🟢
tests/flows-lists.e2e.ts · 7 passed
3m 27s
🟢
infinite scroll reaches the target item
26.0s
🟢
product catalog adds exactly two of the right variant
11.4s
🟢
gestures: long-press, then swipe left
9.9s
🟢
sticky chrome: accept below the fold, then continue
12.2s
🟢
async states: load, pull to refresh, claim through the toast
13.4s
🟢
huge virtualized list reaches row 512
2m 1s
🟢
web view coupon form applies the code shown on the page
12.4s
🟢
tests/flows.e2e.ts · 7 passed
1m 15s
🟢
text inputs unlock the submit button
14.2s
🟢
filled text inputs report their values
12.0s
🟢
modal flow confirms through the native alert
11.0s
🟢
bottom tabs act inside the last tab
7.5s
🟢
error recovery retries, then confirms the delete
9.6s
🟢
choice controls place the exact order
8.1s
🟢
debounced search selects the target once results arrive
control inventory › a label query resolves a labeled text field
33.6s
🟢
control inventory › a labeled field answers name, display value, value reads, fill, and clear
15.5s
🟢
control inventory › a placeholder query and attribute reads find the field
10.3s
🟢
control inventory › a secure field takes a fill and denies value reads
12.1s
🟢
control inventory › press sends a character and Enter through the soft keyboard
12.6s
🟢
control inventory › a field autofocuses on mount and focus() moves the focus
12.9s
🟢
control inventory › toBeFocused follows the focus
9.0s
🟢
control inventory › a switch checks, unchecks, and reports its state
10.2s
🟢
control inventory › checkbox and radio roles answer getByRole, and a checkbox toggles by tap
9.7s
🟢
control inventory › checkbox and radio roles check, uncheck, and report their state
13.1s
🟢
control inventory › a tab role answers getByRole
5.1s
🟢
control inventory › a radio group reports the checked option
8.7s
🟢
control inventory › buttons report disabled, enabled, and a state that arrives later
8.1s
🟢
control inventory › a display: none element is absent rather than hidden, its visible twin attached
7.3s
🟢
control inventory › a header answers its accessible name
5.8s
🟢
control inventory › a tab row answers count, all, texts, filters, positions, and switching
6.5s
🟢
control inventory › a list answers counts, list-form text, reads, and boxes in order
7.3s
⏭️
control inventory › a row contains its texts (skipped: React Native flattens a plain View out of the accessibility tree on both platforms: XCTest and the Android helper report a View with a testID as a leaf beside its children, so filter({ has }) and a query scoped to it match nothing; only Sc…)
🟢
control inventory › a long press lands as one
8.1s
🟢
control inventory › a double tap lands inside the 300 ms window
7.8s
🟢
control inventory › an ambiguous locator fails at once
6.4s
🟢
control inventory › screenshot, restart, and clearState reopen the app on its home list
12.0s
🟢
refusals › verbs a device never declares are refused before the engine
7ms
🟢
refusals › keys the soft keyboard cannot send are refused by the engine
961ms
🟢
refusals › a missing locator fails as not found once its timeout passes
1.2s
🟢
tests/device-fixture.e2e.ts · 9 passed
1m 35s
🟢
device fixture › setOrientation rotates the window the app measures
6.8s
🟢
device fixture › home leaves the app, openApp brings it back where it was
7.0s
🟢
device fixture › foregroundApp sees the home screen after home()
5.9s
🟢
device fixture › closeApp then openApp relaunches on the home list
10.0s
🟢
device fixture › closeApp leaves the next commands on the same device
9.9s
🟢
device fixture › foregroundApp after closeApp reports the closed session as APP_NOT_OPEN
6.3s
🟢
device fixture › device.back pops the scenario
6.1s
🟢
device fixture › setNetwork and setAirplaneMode change what the app sees
17.9s
🟢
device fixture › setLocation and clearLocation change what the app reads
24.9s
🟢
tests/device.e2e.ts · 5 passed
51.3s
🟢
permission prompt › allowing the system dialog enables the microphone
7.9s
🟢
permission prompt › a denied prompt recovers once the permission is granted outside
17.8s
🟢
sequential onboarding echoes the exact values
10.9s
🟢
onboarding rejects a malformed email before advancing
7.0s
🟢
dismissing the keyboard over choice controls leaves them as they were
7.7s
🟢
tests/flows-lists.e2e.ts · 7 passed
2m 23s
🟢
infinite scroll reaches the target item
21.5s
🟢
product catalog adds exactly two of the right variant
10.2s
🟢
gestures: long-press, then swipe left
9.5s
🟢
gestures: double-tap completes the flow
10.4s
🟢
sticky chrome: accept below the fold, then continue
10.5s
🟢
async states: load, pull to refresh, claim through the toast
13.3s
🟢
huge virtualized list reaches row 512
1m 8s
🟢
tests/flows.e2e.ts · 7 passed
56.3s
🟢
text inputs unlock the submit button
7.0s
🟢
filled text inputs report their values
6.2s
🟢
modal flow confirms through the native alert
9.7s
🟢
bottom tabs act inside the last tab
7.5s
🟢
error recovery retries, then confirms the delete
10.1s
🟢
choice controls place the exact order
6.5s
🟢
debounced search selects the target once results arrive
9.3s
🟢
tests/login-form.e2e.ts · 3 passed
30.5s
🟢
login form › rejects a malformed email
8.1s
🟢
login form › rejects an unknown account
8.7s
🟢
login form › signs in and logs out
13.7s
🟢
tests/smoke.e2e.ts · 1 passed
7.1s
🟢
home lists the scenarios and opens one
7.1s
e2e 0.21.3 · 10m 9s · android-emulator · run artifacts
act completes Apple Pay Billing Address (skipped: the CI simulator's Apple Pay sheet skips the billing-address step, so the scenario cannot be completed there)
e2e 0.21.3 · 12m 36s · ios-simulator · run artifacts
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What and why
size:XS..size:XXLlabel (<10, <30, <100, <500, <1000, 1000+ lines), updated on each push. Lets reviewers see how big a PR is from the PR list.*.test.*,*.spec.*,*.e2e.*,tests/,tests-*/,__tests__/,*-snapshots/,__snapshots__/,fixtures/,pnpm-lock.yaml. A PR touching only those is sized by all its lines.pr-policy:pull_request_targetso fork PRs can be labeled, sparse checkout of the base branch'sscripts/pr-sizeonly,fetchwithGITHUB_TOKEN. Never checks out or runs PR code.--dry-runprints the size and writes nothing.scripts/pr-size/size.ts, API calls inscripts/pr-size/label.ts. Labels get created with colors the first time they're used.pr-size.yml.Verified
Ran it locally: yes
node scripts/pr-size/label.ts --dry-runagainst the last 10 PRs here:pull_request_targetuses the base branch copy, so it starts working after merge and won't label this PR.Checklist
pnpm changeset) for any change to a published package, or the change is testbed, docs, or CI only.!, the changeset body names what breaks and what replaces it, and the deprecation warning landed a window earlier (stability policy in CONTRIBUTING.md).docs/**/*.mdxpage for the behavior, andskills/e2e/if the skill describes it..d.tsreviewed,tests/types/sdk-types.tsupdated; wire change edits the schema and both fixtures.e2e/engine): changesets fore2e,@e2e-dev/web, and@e2e-dev/mobile.