Skip to content

ci: label PRs by size without counting tests - #1419

Merged
okwasniewski merged 2 commits into
mainfrom
oskar/pr-size-labels
Oct 28, 2026
Merged

okwasniewski merged 2 commits into
mainfrom
oskar/pr-size-labels

Conversation

@okwasniewski

@okwasniewski okwasniewski commented Oct 28, 2026 •

Copy link
Copy Markdown
Member

What and why

  • Every PR gets one size:XS .. size:XXL label (<10, <30, <100, <500, <1000, 1000+ lines), updated on each push. Lets reviewers see how big a PR is from the PR list.
  • Counts added plus deleted lines from the PR's file list, without *.test.*, *.spec.*, *.e2e.*, tests/, tests-*/, __tests__/, *-snapshots/, __snapshots__/, fixtures/, pnpm-lock.yaml. A PR touching only those is sized by all its lines.
  • Same shape as pr-policy: pull_request_target so fork PRs can be labeled, sparse checkout of the base branch's scripts/pr-size only, fetch with GITHUB_TOKEN. Never checks out or runs PR code. --dry-run prints the size and writes nothing.
  • Rules in scripts/pr-size/size.ts, API calls in scripts/pr-size/label.ts. Labels get created with colors the first time they're used.
  • Idea from T3 Code's pr-size.yml.

Verified

Ran it locally: yes

  • node scripts/pr-size/label.ts --dry-run against the last 10 PRs here:
PR GitHub +/- counted / total label
#1418 +57/-0 57 / 57 size:M
#1417 test-only +240/-0 0 / 240 size:L
#1416 +262/-21 104 / 283 size:L
#1413 +159/-28 84 / 187 size:M
#1412 +1467/-15 1321 / 1482 size:XXL
#1411 +794/-10 804 / 804 size:XL
#1410 +357/-21 77 / 378 size:M
#1408 +265/-9986 1812 / 10251 size:XXL
#1407 +454/-6 160 / 460 size:L
#1401 +231/-18 117 / 249 size:L
  • The workflow itself has not run. pull_request_target uses the base branch copy, so it starts working after merge and won't label this PR.

Checklist

  • Changeset added (pnpm changeset) for any change to a published package, or the change is testbed, docs, or CI only.
  • Breaking change: title carries !, the changeset body names what breaks and what replaces it, and the deprecation warning landed a window earlier (stability policy in CONTRIBUTING.md).
  • Docs updated in the same PR: the docs/**/*.mdx page for the behavior, and skills/e2e/ if the skill describes it.
  • Contract change: emitted .d.ts reviewed, tests/types/sdk-types.ts updated; wire change edits the schema and both fixtures.
  • Engine contract change (e2e/engine): changesets for e2e, @e2e-dev/web, and @e2e-dev/mobile.

View guided diff Turn on auto-fix

@github-actions

github-actions Bot commented Oct 28, 2026 •

Copy link
Copy Markdown
Contributor

🟢 e2e web: 91 passed

All 91 tests in 41 files
Test Time
🟢 tests/aria-hidden-flow.e2e.ts · 2 passed 439ms
🟢 aria hidden flow › picks the Pro plan by its visible text and confirms it 321ms
🟢 aria hidden flow › another plan shows the error and keeps the picker open 118ms
🟢 tests/async-states.e2e.ts · 2 passed 7.0s
🟢 async states › reads the code off the transient toast and verifies it once the button enables 2.2s
🟢 async states › a wrong code is rejected after the toast has gone 4.8s
🟢 tests/canvas-only.e2e.ts · 2 passed 231ms
🟢 canvas only › taps square, circle, then diamond at their pixel coordinates 122ms
🟢 canvas only › a shape out of order paints the error and resets progress 109ms
🟢 tests/canvas-whiteboard.e2e.ts · 2 passed 322ms
🟢 canvas whiteboard › drags both shapes into their slots and saves 189ms
🟢 canvas whiteboard › bounces a shape off the wrong slot and refuses to save early 133ms
🟢 tests/cart-totals.e2e.ts · 2 passed 309ms
🟢 cart totals › increasing a quantity updates the line total but the order summary stays stale (planted bug) 177ms
🟢 cart totals › a quantity never drops below one 132ms
🟢 tests/checkout-review.e2e.ts · 1 passed 131ms
🟢 shows a raw greeting token and an undefined delivery date (planted bug), yet places the order 131ms
🟢 tests/context-menu-trap.e2e.ts · 2 passed 479ms
🟢 context menu trap › right-click opens nothing; the row menu renames the file 248ms
🟢 context menu trap › the decoy menu items refuse and keep the file 231ms
🟢 tests/control-inventory.e2e.ts · 8 passed 3.6s
🟢 control inventory › check sets the checkbox and the radio without flipping a set one 236ms
🟢 control inventory › check picks a radio the pick replaces with its summary 140ms
🟢 control inventory › a long press and a double click are told apart from a tap 1.0s
🟢 control inventory › the file menu opens on right-click only and Rename renames the file 234ms
🟢 control inventory › setInputFiles attaches files named from the project root 127ms
🟢 control inventory › the details view is left through the browser history 155ms
🟢 control inventory › scrollIntoView brings the footnote into view 270ms
🟢 control inventory › every exercise done shows the success message 1.4s
🟢 tests/css-content-ui.e2e.ts · 2 passed 293ms
🟢 css content ui › the tile labelled Ship it advances and confirming ships 158ms
🟢 css content ui › a wrong tile shows the CSS-rendered error and keeps the picker 135ms
🟢 tests/date-picker.e2e.ts · 2 passed 529ms
🟢 date picker › navigates three months ahead and books the required date 313ms
🟢 date picker › confirming without the exact date shows the error 216ms
🟢 tests/debounced-search.e2e.ts · 2 passed 2.8s
🟢 debounced search › a decoy one character off is refused 1.4s
🟢 debounced search › picking the exact item adds it to the cart 1.4s
🟢 tests/deferred-dialog.e2e.ts · 1 passed 1.1s
🟢 one submit opens one confirm, even when double-clicked 1.1s
🟢 tests/div-soup.e2e.ts · 2 passed 592ms
🟢 div soup › a wrong code is rejected 262ms
🟢 div soup › the right code grants access after the delete tile fixes a typo 330ms
🟢 tests/drag-and-drop.e2e.ts · 2 passed 598ms
🟢 drag and drop › an out-of-order item resets the dropzone 299ms
🟢 drag and drop › dropping Banana then Cherry passes 299ms
🟢 tests/filter-deep-link.e2e.ts · 2 passed 199ms
🟢 filter deep link › filtering writes the query to the URL 113ms
🟢 filter deep link › opening a shared link restores the filter 86ms
🟢 tests/gift-card-purchase.e2e.ts · 3 passed 482ms
🟢 gift card purchase › refuses to buy without an amount 132ms
🟢 gift card purchase › refuses a recipient without an at sign 183ms
🟢 gift card purchase › sends the gift card 167ms
🟢 tests/hover-menu.e2e.ts · 2 passed 397ms
🟢 hover menu › a decoy leaf is refused 181ms
🟢 hover menu › hovering Account, then Billing, reaches Redeem voucher 216ms
🟢 tests/iframe-form.e2e.ts · 2 passed 426ms
🟢 iframe form › a wrong code is refused by the host page 209ms
🟢 iframe form › the code read from one frame applies through the other 217ms
🟢 tests/image-only-ui.e2e.ts · 3 passed 370ms
🟢 image only ui › the icons have no names, so the bare svg locator is ambiguous 84ms
🟢 image only ui › a wrong icon shows the error image and keeps the icons 121ms
🟢 image only ui › tapping the star, then the heart, verifies the icons 165ms
🟢 tests/infinite-scroll.e2e.ts · 1 passed 2.9s
🟢 scrolls the feed until the Golden Ticket loads, then claims it 2.9s
🟢 tests/kanban-board.e2e.ts · 3 passed 635ms
🟢 kanban board › pointer drags move both cards into the goal layout 316ms
🟢 kanban board › a swipe along a path drags a card as well 136ms
🟢 kanban board › a plain tap moves nothing and the untouched board is rejected 183ms
🟢 tests/login-form.e2e.ts · 4 passed 681ms
🟢 login form › rejects a malformed email 163ms
🟢 login form › rejects a short password 150ms
🟢 login form › rejects an unknown account 166ms
🟢 login form › signs in and logs out 202ms
🟢 tests/lying-labels.e2e.ts · 4 passed 579ms
🟢 lying labels › the button whose accessible name says Pay now is the wrong one 132ms
🟢 lying labels › a text match for Pay now catches the decoy phrase too 92ms
🟢 lying labels › the field whose accessible name says Amount is the wrong one 171ms
🟢 lying labels › visible text drives the payment through 184ms
🟢 tests/native-dialogs.e2e.ts · 3 passed 382ms
🟢 native dialogs › answers the confirm, prompt, and alert chain 117ms
🟢 native dialogs › dismissing the confirm cancels the order 132ms
🟢 native dialogs › a wrong gift code is rejected 133ms
🟢 tests/newsletter-signup.e2e.ts · 1 passed 2.2s
🟢 subscribe renders no feedback and logs a TypeError (planted bug) 2.2s
🟢 tests/onboarding-wizard.e2e.ts · 5 passed 4.5s
🟢 onboarding wizard › back keeps what was typed and the brief comes back with it 246ms
🟢 onboarding wizard › the address step takes the brief through its bare-div dropdown 314ms
🟢 onboarding wizard › the profile step steers the calendar three decades back 1.2s
🟢 onboarding wizard › the preferences step flips the toggles the brief names and leaves the trap off 1.4s
🟢 onboarding wizard › the review step repeats the brief and finishes with the PIN 1.4s
🟢 tests/order-history.e2e.ts · 2 passed 1.4s
🟢 order history › overview and settings render their panels 164ms
🟢 order history › the orders tab never leaves its loading state (planted bug) 1.2s
🟢 tests/otp-auto-advance.e2e.ts · 3 passed 1.3s
🟢 otp auto-advance › focus advances with each digit and the full code verifies 456ms
🟢 otp auto-advance › backspace on an empty box clears and refocuses the previous one 133ms
🟢 otp auto-advance › a wrong code clears every box and starts over 754ms
🟢 tests/overlay-trap.e2e.ts · 1 passed 688ms
🟢 continues only after the banner and the overlay are gone 688ms
🟢 tests/playbook-cleanup.e2e.ts · 2 passed 414ms
🟢 playbook cleanup › deleting the draft removes it from an exact-name search 200ms
🟢 playbook cleanup › cancelling the dialog keeps the draft searchable 214ms
🟢 tests/price-sorting.e2e.ts · 3 passed 328ms
🟢 price sorting › opens in the featured order with sale prices struck through 93ms
🟢 price sorting › low to high sorts by the original price, not the paid one (planted bug) 109ms
🟢 price sorting › high to low is the same wrong order reversed (planted bug) 126ms
🟢 tests/product-reviews.e2e.ts · 1 passed 1.1s
🟢 the running-shoe page lists coffee-grinder reviews (planted bug) 1.1s
🟢 tests/promo-storefront.e2e.ts · 1 passed 1.3s
🟢 buys a deal once the promo chrome is out of the way 1.3s
🟢 tests/rich-text-editor.e2e.ts · 2 passed 410ms
🟢 rich text editor › bolding exactly the required word passes the check 211ms
🟢 rich text editor › bold that spills into the previous word fails the check 199ms
🟢 tests/saved-addresses.e2e.ts · 3 passed 449ms
🟢 saved addresses › adds an address and clears the form 157ms
🟢 saved addresses › ignores an add with an empty field 144ms
🟢 saved addresses › delete shows its toast but keeps the address, on retry too (planted bug) 148ms
🟢 tests/shadow-dom-form.e2e.ts · 2 passed 499ms
🟢 shadow DOM form › rejects a wrong access code 249ms
🟢 shadow DOM form › grants access with the code from the hint inside the root 250ms
🟢 tests/smoke.e2e.ts · 1 passed 413ms
🟢 home lists the scenarios and opens one 413ms
🟢 tests/stale-dom.e2e.ts · 1 passed 2.1s
🟢 taps the moving target three times across rebuilds of the list 2.1s
🟢 tests/sticky-chrome.e2e.ts · 1 passed 171ms
🟢 accepts the terms once the button clears the sticky footer 171ms
🟢 tests/virtualized-table.e2e.ts · 1 passed 14.9s
🟢 scrolls the windowed table to the Golden Row and claims it 14.9s
🟢 tests/wishlist.e2e.ts · 2 passed 1.4s
🟢 wishlist › saving toggles the button and the tab badge 190ms
🟢 wishlist › the wishlist tab renders the empty state despite the badge count (planted bug) 1.2s

e2e 0.21.3 · 59.6s · web · run artifacts

@github-actions

github-actions Bot commented Oct 28, 2026 •

Copy link
Copy Markdown
Contributor

🟢 e2e web agent: 33 passed

34 agent steps · 26 replayed from cache · 22 model calls · 90.3k tokens (85% cached) · $0.0056

All 33 tests in 5 files
Test Agent Time
🟢 tests-agent/control-inventory.e2e.ts · 7 passed 7 steps 7.3s
🟢 control inventory › check sets the checkbox and the radio 1 step 551ms
🟢 control inventory › check picks a radio the pick replaces with its summary 1 step 254ms
🟢 control inventory › a long press and a double click are chosen over a plain tap 1 step 925ms
🟢 control inventory › a right-click opens the file menu and Rename renames the file 1 step 2.6s
🟢 control inventory › upload attaches the named project files 1 step 2.4s
🟢 control inventory › back returns from the details view to the inventory 1 step 256ms
🟢 control inventory › scroll_to brings the footnote into view 1 step 345ms
🟢 tests-agent/login-form.e2e.ts · 1 passed 1 step 321ms
🟢 act signs in with the benchmark account 1 step 321ms
🟢 tests-agent/planted-bugs.e2e.ts · 3 passed 4 steps · 8 calls 19.1s
🟢 cart totals: a judgment catches the stale order summary 2 steps · 4 calls 9.8s
🟢 checkout review: a judgment catches the broken copy 1 step · 1 call 2.1s
🟢 wishlist: a judgment catches the lost saved items 1 step · 3 calls 7.1s
🟢 tests-agent/scenarios.e2e.ts · 21 passed 21 steps · 14 calls 1m 59s
🟢 act completes shadow-dom-form 1 step · 5 calls 9.8s
🟢 act completes lying-labels 1 step · 3 calls 7.0s
🟢 act completes iframe-form 1 step · 3 calls 6.7s
🟢 act completes infinite-scroll 1 step 5.0s
🟢 act completes virtualized-table 1 step 55.5s
🟢 act completes overlay-trap 1 step 956ms
🟢 act completes sticky-chrome 1 step 1.0s
🟢 act completes async-states 1 step · 3 calls 8.8s
🟢 act completes debounced-search 1 step 2.3s
🟢 act completes hover-menu 1 step 542ms
🟢 act completes drag-and-drop 1 step 494ms
🟢 act completes kanban-board 1 step 719ms
🟢 act completes context-menu-trap 1 step 2.7s
🟢 act completes stale-dom 1 step 551ms
🟢 act completes otp-auto-advance 1 step 797ms
🟢 act completes date-picker 1 step 946ms
🟢 act completes rich-text-editor 1 step 10.4s
🟢 act completes playbook-cleanup 1 step 684ms
🟢 act completes promo-storefront 1 step 1.4s
🟢 act completes gift-card-purchase 1 step 2.5s
🟢 act filters the list and the URL carries the filter 1 step 298ms
🟢 tests-agent/unique-cache.e2e.ts · 1 passed 1 step 372ms
🟢 act adds an address with a run-unique label 1 step 372ms

e2e 0.21.3 · 2m 27s · web · run artifacts

@github-actions

github-actions Bot commented Oct 28, 2026 •

Copy link
Copy Markdown
Contributor

🟢 e2e android agent: 1 flaky, 19 passed

24 agent steps · 15 replayed from cache · 34 model calls · 382.0k tokens (78% cached) · $0.0299

⚠️ 1 flaky test passed on a retry

⚠️ act completes Async States
tests-agent/scenarios.e2e.ts:266

ASSERTION_FAILED at step 4 of 4: agent.act "Complete this scenario as the screen instructs: wait for the screen to load, scroll up on the reward area to refresh it, then claim the reward", after 1m 34s and 24 model calls

agent.act failed: Waited for loading to finish, pulled down on the reward area until the Claim reward button appeared, and tapped it. The latest screen still shows “Claiming reward…” with no completed-claim confirmation, so the reward outcome was not verified.

  • Turn 21: swipe({"from":{"x":172,"y":300},"to":{"x":172,"y":650}}) → [swipe] Swiped from (172, 300) to (172, 650).
  • Turn 22: screenshot({}) → [screenshot] The screen changed substantially since revision b24. Current screen (revision b26, path dev.e2e.benchmark, 21 nodes):
  • Turn 23: tap({"target":"n5103"}) → [tap] Tapped #n5103.
  • Screen: dev.e2e.benchmark

Evidence: screenshot, log

All 20 tests in 1 file
Test Agent Time
⚠️ tests-agent/scenarios.e2e.ts · 1 flaky, 19 passed 24 steps · 34 calls 6m 38s
🟢 act completes Login Form 1 step 42.7s
🟢 act completes Infinite Scroll List 1 step 26.1s
🟢 act completes Modal Flow 1 step 13.3s
🟢 act completes Bottom Tabs 1 step 9.8s
🟢 act completes Text Input Variations 1 step 8.0s
🟢 act completes Broken Accessibility 2 steps · 5 calls 23.5s
🟢 act completes Vision Only 2 steps · 1 call 10.0s
🟢 act completes Gestures 1 step · 7 calls 26.8s
⚠️ act completes Async States (1 failed attempt first) 1 step · 9 calls 32.0s
🟢 act completes Debounced Search 1 step 8.0s
🟢 act completes Huge Virtualized List 1 step 1m 14s
🟢 act completes Flattened Registration Form 2 steps · 1 call 16.1s
🟢 act completes Flattened Login 2 steps · 6 calls 27.1s
🟢 act completes Sticky Chrome Target 1 step 8.9s
🟢 act completes WebView Accessibility 1 step · 5 calls 20.6s
🟢 act completes Permission Prompt 1 step 9.7s
🟢 act completes Product Catalog 1 step 10.2s
🟢 act completes Error Recovery 1 step 11.2s
🟢 act completes Choice Controls 1 step 9.8s
🟢 act completes Sequential Onboarding 1 step 10.8s

e2e 0.21.3 · 8m 18s · android-emulator · run artifacts

@github-actions

github-actions Bot commented Oct 28, 2026 •

Copy link
Copy Markdown
Contributor

🟢 e2e ios: 54 passed, 1 skipped

All 55 tests in 7 files
Test Time
⏭️ tests/controls.e2e.ts · 23 passed, 1 skipped 3m 8s
🟢 control inventory › a label query resolves a labeled text field 12.4s
🟢 control inventory › a labeled field answers name, display value, value reads, fill, and clear 14.7s
🟢 control inventory › a placeholder query and attribute reads find the field 4.5s
🟢 control inventory › a secure field takes a fill and denies value reads 9.1s
🟢 control inventory › press sends a character and Enter through the soft keyboard 8.5s
🟢 control inventory › a field autofocuses on mount and focus() moves the focus 10.5s
🟢 control inventory › toBeFocused follows the focus 9.5s
🟢 control inventory › a switch checks, unchecks, and reports its state 10.2s
🟢 control inventory › checkbox and radio roles answer getByRole, and a checkbox toggles by tap 8.8s
🟢 control inventory › checkbox and radio roles check, uncheck, and report their state 13.0s
🟢 control inventory › a radio group reports the checked option 9.3s
🟢 control inventory › buttons report disabled, enabled, and a state that arrives later 9.2s
🟢 control inventory › a display: none element is absent rather than hidden, its visible twin attached 7.9s
🟢 control inventory › a header answers its accessible name 5.3s
🟢 control inventory › a tab row answers count, all, texts, filters, positions, and switching 7.0s
🟢 control inventory › a list answers counts, list-form text, reads, and boxes in order 7.4s
⏭️ control inventory › a row contains its texts (skipped: React Native flattens a plain View out of the accessibility tree on both platforms: XCTest and the Android helper report a View with a testID as a leaf beside its children, so filter({ has }) and a query scoped to it match nothing; only Sc…)
🟢 control inventory › a long press lands as one 9.0s
🟢 control inventory › pointer verbs land at the point asked for 10.4s
🟢 control inventory › an ambiguous locator fails at once 6.1s
🟢 control inventory › screenshot, restart, and clearState reopen the app on its home list 14.0s
🟢 refusals › verbs a device never declares are refused before the engine 2ms
🟢 refusals › keys the soft keyboard cannot send are refused by the engine 494ms
🟢 refusals › a missing locator fails as not found once its timeout passes 1.1s
🟢 tests/device-fixture.e2e.ts · 10 passed 1m 25s
🟢 device fixture › setAppearance flips the color scheme the app reads 12.5s
🟢 device fixture › setOrientation rotates the window the app measures 7.5s
🟢 device fixture › the clipboard reads back what was written 5.7s
🟢 device fixture › home leaves the app, openApp brings it back where it was 5.9s
🟢 device fixture › closeApp then openApp relaunches on the home list 8.2s
🟢 device fixture › closeApp leaves the next commands on the same device 9.9s
🟢 device fixture › foregroundApp after closeApp reports the closed session as APP_NOT_OPEN 6.7s
🟢 device fixture › device.back pops the scenario 6.1s
🟢 device fixture › setLocation and clearLocation change what the app reads 11.6s
🟢 device fixture › enrollBiometrics and setBiometrics answer a biometric prompt 10.8s
🟢 tests/device.e2e.ts · 3 passed 1m 10s
🟢 sequential onboarding echoes the exact values 42.2s
🟢 onboarding rejects a malformed email before advancing 15.1s
🟢 dismissing the keyboard over choice controls leaves them as they were 13.0s
🟢 tests/flows-lists.e2e.ts · 7 passed 3m 27s
🟢 infinite scroll reaches the target item 26.0s
🟢 product catalog adds exactly two of the right variant 11.4s
🟢 gestures: long-press, then swipe left 9.9s
🟢 sticky chrome: accept below the fold, then continue 12.2s
🟢 async states: load, pull to refresh, claim through the toast 13.4s
🟢 huge virtualized list reaches row 512 2m 1s
🟢 web view coupon form applies the code shown on the page 12.4s
🟢 tests/flows.e2e.ts · 7 passed 1m 15s
🟢 text inputs unlock the submit button 14.2s
🟢 filled text inputs report their values 12.0s
🟢 modal flow confirms through the native alert 11.0s
🟢 bottom tabs act inside the last tab 7.5s
🟢 error recovery retries, then confirms the delete 9.6s
🟢 choice controls place the exact order 8.1s
🟢 debounced search selects the target once results arrive 12.1s
🟢 tests/login-form.e2e.ts · 3 passed 53.9s
🟢 login form › rejects a malformed email 14.6s
🟢 login form › rejects an unknown account 14.9s
🟢 login form › signs in and logs out 24.4s
🟢 tests/smoke.e2e.ts · 1 passed 8.3s
🟢 home lists the scenarios and opens one 8.3s

e2e 0.21.3 · 6m 2s · ios-simulator · run artifacts

@github-actions

github-actions Bot commented Oct 28, 2026 •

Copy link
Copy Markdown
Contributor

🟢 e2e android: 56 passed, 1 skipped

All 57 tests in 7 files
Test Time
⏭️ tests/controls.e2e.ts · 24 passed, 1 skipped 3m 44s
🟢 control inventory › a label query resolves a labeled text field 33.6s
🟢 control inventory › a labeled field answers name, display value, value reads, fill, and clear 15.5s
🟢 control inventory › a placeholder query and attribute reads find the field 10.3s
🟢 control inventory › a secure field takes a fill and denies value reads 12.1s
🟢 control inventory › press sends a character and Enter through the soft keyboard 12.6s
🟢 control inventory › a field autofocuses on mount and focus() moves the focus 12.9s
🟢 control inventory › toBeFocused follows the focus 9.0s
🟢 control inventory › a switch checks, unchecks, and reports its state 10.2s
🟢 control inventory › checkbox and radio roles answer getByRole, and a checkbox toggles by tap 9.7s
🟢 control inventory › checkbox and radio roles check, uncheck, and report their state 13.1s
🟢 control inventory › a tab role answers getByRole 5.1s
🟢 control inventory › a radio group reports the checked option 8.7s
🟢 control inventory › buttons report disabled, enabled, and a state that arrives later 8.1s
🟢 control inventory › a display: none element is absent rather than hidden, its visible twin attached 7.3s
🟢 control inventory › a header answers its accessible name 5.8s
🟢 control inventory › a tab row answers count, all, texts, filters, positions, and switching 6.5s
🟢 control inventory › a list answers counts, list-form text, reads, and boxes in order 7.3s
⏭️ control inventory › a row contains its texts (skipped: React Native flattens a plain View out of the accessibility tree on both platforms: XCTest and the Android helper report a View with a testID as a leaf beside its children, so filter({ has }) and a query scoped to it match nothing; only Sc…)
🟢 control inventory › a long press lands as one 8.1s
🟢 control inventory › a double tap lands inside the 300 ms window 7.8s
🟢 control inventory › an ambiguous locator fails at once 6.4s
🟢 control inventory › screenshot, restart, and clearState reopen the app on its home list 12.0s
🟢 refusals › verbs a device never declares are refused before the engine 7ms
🟢 refusals › keys the soft keyboard cannot send are refused by the engine 961ms
🟢 refusals › a missing locator fails as not found once its timeout passes 1.2s
🟢 tests/device-fixture.e2e.ts · 9 passed 1m 35s
🟢 device fixture › setOrientation rotates the window the app measures 6.8s
🟢 device fixture › home leaves the app, openApp brings it back where it was 7.0s
🟢 device fixture › foregroundApp sees the home screen after home() 5.9s
🟢 device fixture › closeApp then openApp relaunches on the home list 10.0s
🟢 device fixture › closeApp leaves the next commands on the same device 9.9s
🟢 device fixture › foregroundApp after closeApp reports the closed session as APP_NOT_OPEN 6.3s
🟢 device fixture › device.back pops the scenario 6.1s
🟢 device fixture › setNetwork and setAirplaneMode change what the app sees 17.9s
🟢 device fixture › setLocation and clearLocation change what the app reads 24.9s
🟢 tests/device.e2e.ts · 5 passed 51.3s
🟢 permission prompt › allowing the system dialog enables the microphone 7.9s
🟢 permission prompt › a denied prompt recovers once the permission is granted outside 17.8s
🟢 sequential onboarding echoes the exact values 10.9s
🟢 onboarding rejects a malformed email before advancing 7.0s
🟢 dismissing the keyboard over choice controls leaves them as they were 7.7s
🟢 tests/flows-lists.e2e.ts · 7 passed 2m 23s
🟢 infinite scroll reaches the target item 21.5s
🟢 product catalog adds exactly two of the right variant 10.2s
🟢 gestures: long-press, then swipe left 9.5s
🟢 gestures: double-tap completes the flow 10.4s
🟢 sticky chrome: accept below the fold, then continue 10.5s
🟢 async states: load, pull to refresh, claim through the toast 13.3s
🟢 huge virtualized list reaches row 512 1m 8s
🟢 tests/flows.e2e.ts · 7 passed 56.3s
🟢 text inputs unlock the submit button 7.0s
🟢 filled text inputs report their values 6.2s
🟢 modal flow confirms through the native alert 9.7s
🟢 bottom tabs act inside the last tab 7.5s
🟢 error recovery retries, then confirms the delete 10.1s
🟢 choice controls place the exact order 6.5s
🟢 debounced search selects the target once results arrive 9.3s
🟢 tests/login-form.e2e.ts · 3 passed 30.5s
🟢 login form › rejects a malformed email 8.1s
🟢 login form › rejects an unknown account 8.7s
🟢 login form › signs in and logs out 13.7s
🟢 tests/smoke.e2e.ts · 1 passed 7.1s
🟢 home lists the scenarios and opens one 7.1s

e2e 0.21.3 · 10m 9s · android-emulator · run artifacts

@github-actions

github-actions Bot commented Oct 28, 2026 •

Copy link
Copy Markdown
Contributor

🟢 e2e ios agent: 21 passed, 1 skipped

25 agent steps · 6 replayed from cache · 74 model calls · 460.8k tokens (82% cached) · $0.0312

All 22 tests in 1 file
Test Agent Time
⏭️ tests-agent/scenarios.e2e.ts · 21 passed, 1 skipped 25 steps · 74 calls 12m 35s
🟢 act completes Login Form 1 step 40.3s
🟢 act completes Infinite Scroll List 1 step · 1 call 49.0s
🟢 act completes Modal Flow 1 step · 1 call 27.3s
🟢 act completes Bottom Tabs 1 step · 1 call 23.8s
🟢 act completes Text Input Variations 1 step · 3 calls 35.5s
🟢 act completes Broken Accessibility 2 steps · 12 calls 1m 23s
🟢 act completes Vision Only 2 steps · 6 calls 34.4s
🟢 act completes Gestures 1 step · 7 calls 42.0s
🟢 act completes Async States 1 step · 7 calls 35.1s
🟢 act completes Debounced Search 1 step · 1 call 29.5s
🟢 act completes Flattened Registration Form 2 steps · 1 call 30.5s
🟢 act completes Flattened Login 2 steps · 11 calls 1m 11s
🟢 act completes Sticky Chrome Target 1 step · 2 calls 57.0s
🟢 act completes WebView Accessibility 1 step 13.7s
🟢 act completes Permission Prompt 1 step 11.6s
🟢 act completes Photo Picker 1 step · 2 calls 32.7s
🟢 act completes Product Catalog 1 step 10.4s
🟢 act completes Error Recovery 1 step 9.7s
🟢 act completes Choice Controls 1 step · 6 calls 40.5s
🟢 act completes Stripe PaymentSheet 1 step · 12 calls 44.5s
🟢 act completes Apple Pay 1 step · 1 call 34.1s
⏭️ act completes Apple Pay Billing Address (skipped: the CI simulator's Apple Pay sheet skips the billing-address step, so the scenario cannot be completed there)

e2e 0.21.3 · 12m 36s · ios-simulator · run artifacts

@okwasniewski
okwasniewski merged commit 4d53666 into main Oct 28, 2026
29 checks passed
@okwasniewski
okwasniewski deleted the oskar/pr-size-labels branch October 28, 2026 02:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant