Skip to content

refactor(e2e): split the session half of a worker from the runner - #1736

Merged
okwasniewski merged 2 commits into
mainfrom
kdy1/e2e-core-1-split
Nov 15, 2026
Merged

okwasniewski merged 2 commits into
mainfrom
kdy1/e2e-core-1-split

Conversation

@kdy1

@kdy1 kdy1 commented Nov 13, 2026 •

Copy link
Copy Markdown
Collaborator

Stack 1/3: this PR → move into @e2e-dev/core → @e2e-dev/core API.

2026-11-15: rebased onto main 235986078 and the package renamed from e2e-core to @e2e-dev/core. Command output quoted below predates the rename.

A refactor inside packages/e2e with no behavior change. It separates the half of a worker that drives an engine from the half that runs tests, so the next PR can move the first half into its own package.

flowchart LR
  subgraph engine["session half (moves to @e2e-dev/core in 2/3)"]
    ES["EngineSessions<br/>engine init and dispose,<br/>attempt launch and close"]
    W["openWorker + WorkerPolicy"]
    A["launchAttempt + AttemptPolicy"]
    P["resolveProjectConfig"]
  end
  subgraph runner["runner half (stays in e2e)"]
    TE["TargetExecutor"]
    K["standalone-kinds.ts<br/>hosted, one-shot"]
    R["resolveConfig<br/>reporters, filters"]
  end
  TE -- extends --> ES
  K -- policy --> W
  K -- policy --> A
  R -- over --> P
Loading
  • run/engine-sessions.ts: EngineSessions takes engine init and dispose, and each attempt's session from launch to close, out of TargetExecutor, which now extends it.
  • run/standalone.ts and run/standalone-attempt.ts: the standalone worker takes a WorkerPolicy (who claims the engine, what runs its sessions) and an AttemptPolicy (identity, reserve, launched, closed hooks). The hosted (openHost) and one-shot (MCP) kinds move to run/standalone-kinds.ts, with the publication, soft failures, and host trace they own.
  • Config: resolveProjectConfig (config/resolve.ts) resolves everything but reporters and test filters. resolveConfig in the new config/resolve-run.ts adds those on top.
  • Types: ProjectConfig (types.ts) is E2EConfig without reporters and filters. E2EConfig, Report, Reporter, and the filter types move to src/run-types.ts. e2e exports ProjectConfig (changeset).
  • Smaller moves: describeTarget → run/provision.ts, TestIdentity/SkipInfo → run/records.ts, and pairRecording → internal/recording-modes.ts, so the session side never imports collect/.

Verified

Ran it locally: yes. A refactor shows no behavior on screen, so the evidence is the existing suites, unchanged, against the built packages:

  • pnpm test: e2e 4624 passed (unit and integration), web 810, mobile 531, every other package green.
  • Testbed through the built CLI (pnpm --filter @e2e-dev/testbed test): 588 passed, 1 skipped.
  • pnpm check passes.

🤖 Generated with Claude Code

@kdy1
kdy1 requested a review from okwasniewski as a code owner November 13, 2026 06:58
@github-actions github-actions Bot added the size:XXL 1,000+ changed lines, not counting tests, fixtures, or the lockfile label Nov 13, 2026
@github-actions

github-actions Bot commented Nov 13, 2026 •

Copy link
Copy Markdown
Contributor

🟢 e2e web: 93 passed

All 93 tests in 42 files
Test Time
🟢 tests/aria-hidden-flow.e2e.ts · 2 passed 552ms
🟢 aria hidden flow › picks the Pro plan by its visible text and confirms it 416ms
🟢 aria hidden flow › another plan shows the error and keeps the picker open 136ms
🟢 tests/async-states.e2e.ts · 2 passed 7.0s
🟢 async states › reads the code off the transient toast and verifies it once the button enables 2.2s
🟢 async states › a wrong code is rejected after the toast has gone 4.8s
🟢 tests/canvas-only.e2e.ts · 2 passed 225ms
🟢 canvas only › taps square, circle, then diamond at their pixel coordinates 122ms
🟢 canvas only › a shape out of order paints the error and resets progress 103ms
🟢 tests/canvas-whiteboard.e2e.ts · 2 passed 327ms
🟢 canvas whiteboard › drags both shapes into their slots and saves 197ms
🟢 canvas whiteboard › bounces a shape off the wrong slot and refuses to save early 130ms
🟢 tests/cart-totals.e2e.ts · 2 passed 315ms
🟢 cart totals › increasing a quantity updates the line total but the order summary stays stale (planted bug) 171ms
🟢 cart totals › a quantity never drops below one 144ms
🟢 tests/checkout-review.e2e.ts · 1 passed 144ms
🟢 shows a raw greeting token and an undefined delivery date (planted bug), yet places the order 144ms
🟢 tests/context-menu-trap.e2e.ts · 2 passed 544ms
🟢 context menu trap › right-click opens nothing; the row menu renames the file 283ms
🟢 context menu trap › the decoy menu items refuse and keep the file 261ms
🟢 tests/control-inventory.e2e.ts · 8 passed 3.3s
🟢 control inventory › check sets the checkbox and the radio without flipping a set one 214ms
🟢 control inventory › check picks a radio the pick replaces with its summary 138ms
🟢 control inventory › a long press and a double click are told apart from a tap 960ms
🟢 control inventory › the file menu opens on right-click only and Rename renames the file 219ms
🟢 control inventory › setInputFiles attaches files named from the project root 119ms
🟢 control inventory › the details view is left through the browser history 142ms
🟢 control inventory › scrollIntoView brings the footnote into view 238ms
🟢 control inventory › every exercise done shows the success message 1.3s
🟢 tests/css-content-ui.e2e.ts · 2 passed 281ms
🟢 css content ui › the tile labelled Ship it advances and confirming ships 162ms
🟢 css content ui › a wrong tile shows the CSS-rendered error and keeps the picker 119ms
🟢 tests/date-picker.e2e.ts · 2 passed 561ms
🟢 date picker › navigates three months ahead and books the required date 313ms
🟢 date picker › confirming without the exact date shows the error 248ms
🟢 tests/debounced-search.e2e.ts · 2 passed 2.8s
🟢 debounced search › a decoy one character off is refused 1.4s
🟢 debounced search › picking the exact item adds it to the cart 1.4s
🟢 tests/deferred-dialog.e2e.ts · 1 passed 1.1s
🟢 one submit opens one confirm, even when double-clicked 1.1s
🟢 tests/div-soup.e2e.ts · 2 passed 578ms
🟢 div soup › a wrong code is rejected 261ms
🟢 div soup › the right code grants access after the delete tile fixes a typo 317ms
🟢 tests/drag-and-drop.e2e.ts · 2 passed 598ms
🟢 drag and drop › an out-of-order item resets the dropzone 297ms
🟢 drag and drop › dropping Banana then Cherry passes 301ms
🟢 tests/filter-deep-link.e2e.ts · 2 passed 203ms
🟢 filter deep link › filtering writes the query to the URL 116ms
🟢 filter deep link › opening a shared link restores the filter 87ms
🟢 tests/gift-card-purchase.e2e.ts · 3 passed 495ms
🟢 gift card purchase › refuses to buy without an amount 130ms
🟢 gift card purchase › refuses a recipient without an at sign 180ms
🟢 gift card purchase › sends the gift card 185ms
🟢 tests/hover-menu.e2e.ts · 2 passed 413ms
🟢 hover menu › a decoy leaf is refused 181ms
🟢 hover menu › hovering Account, then Billing, reaches Redeem voucher 232ms
🟢 tests/iframe-form.e2e.ts · 2 passed 544ms
🟢 iframe form › a wrong code is refused by the host page 211ms
🟢 iframe form › the code read from one frame applies through the other 333ms
🟢 tests/image-only-ui.e2e.ts · 3 passed 402ms
🟢 image only ui › the icons have no names, so the bare svg locator is ambiguous 89ms
🟢 image only ui › a wrong icon shows the error image and keeps the icons 132ms
🟢 image only ui › tapping the star, then the heart, verifies the icons 181ms
🟢 tests/infinite-scroll.e2e.ts · 1 passed 2.6s
🟢 scrolls the feed until the Golden Ticket loads, then claims it 2.6s
🟢 tests/kanban-board.e2e.ts · 3 passed 621ms
🟢 kanban board › pointer drags move both cards into the goal layout 338ms
🟢 kanban board › a swipe along a path drags a card as well 135ms
🟢 kanban board › a plain tap moves nothing and the untouched board is rejected 148ms
🟢 tests/login-form.e2e.ts · 4 passed 664ms
🟢 login form › rejects a malformed email 165ms
🟢 login form › rejects a short password 149ms
🟢 login form › rejects an unknown account 151ms
🟢 login form › signs in and logs out 199ms
🟢 tests/lying-labels.e2e.ts · 4 passed 564ms
🟢 lying labels › the button whose accessible name says Pay now is the wrong one 134ms
🟢 lying labels › a text match for Pay now catches the decoy phrase too 87ms
🟢 lying labels › the field whose accessible name says Amount is the wrong one 177ms
🟢 lying labels › visible text drives the payment through 166ms
🟢 tests/native-dialogs.e2e.ts · 3 passed 401ms
🟢 native dialogs › answers the confirm, prompt, and alert chain 135ms
🟢 native dialogs › dismissing the confirm cancels the order 133ms
🟢 native dialogs › a wrong gift code is rejected 133ms
🟢 tests/new-tab-flow.e2e.ts · 2 passed 380ms
🟢 new tab flow › reads the code in the tab the app opens and enters it back in the original tab 195ms
🟢 new tab flow › a tap that opens a tab leaves the screen on the original tab, and activate shows the new one 185ms
🟢 tests/newsletter-signup.e2e.ts · 1 passed 2.2s
🟢 subscribe renders no feedback and logs a TypeError (planted bug) 2.2s
🟢 tests/onboarding-wizard.e2e.ts · 5 passed 4.1s
🟢 onboarding wizard › back keeps what was typed and the brief comes back with it 232ms
🟢 onboarding wizard › the address step takes the brief through its bare-div dropdown 299ms
🟢 onboarding wizard › the profile step steers the calendar three decades back 1.1s
🟢 onboarding wizard › the preferences step flips the toggles the brief names and leaves the trap off 1.2s
🟢 onboarding wizard › the review step repeats the brief and finishes with the PIN 1.3s
🟢 tests/order-history.e2e.ts · 2 passed 1.4s
🟢 order history › overview and settings render their panels 162ms
🟢 order history › the orders tab never leaves its loading state (planted bug) 1.2s
🟢 tests/otp-auto-advance.e2e.ts · 3 passed 1.3s
🟢 otp auto-advance › focus advances with each digit and the full code verifies 448ms
🟢 otp auto-advance › backspace on an empty box clears and refocuses the previous one 130ms
🟢 otp auto-advance › a wrong code clears every box and starts over 754ms
🟢 tests/overlay-trap.e2e.ts · 1 passed 699ms
🟢 continues only after the banner and the overlay are gone 699ms
🟢 tests/playbook-cleanup.e2e.ts · 2 passed 410ms
🟢 playbook cleanup › deleting the draft removes it from an exact-name search 213ms
🟢 playbook cleanup › cancelling the dialog keeps the draft searchable 197ms
🟢 tests/price-sorting.e2e.ts · 3 passed 340ms
🟢 price sorting › opens in the featured order with sale prices struck through 97ms
🟢 price sorting › low to high sorts by the original price, not the paid one (planted bug) 117ms
🟢 price sorting › high to low is the same wrong order reversed (planted bug) 126ms
🟢 tests/product-reviews.e2e.ts · 1 passed 1.1s
🟢 the running-shoe page lists coffee-grinder reviews (planted bug) 1.1s
🟢 tests/promo-storefront.e2e.ts · 1 passed 1.3s
🟢 buys a deal once the promo chrome is out of the way 1.3s
🟢 tests/rich-text-editor.e2e.ts · 2 passed 416ms
🟢 rich text editor › bolding exactly the required word passes the check 213ms
🟢 rich text editor › bold that spills into the previous word fails the check 203ms
🟢 tests/saved-addresses.e2e.ts · 3 passed 478ms
🟢 saved addresses › adds an address and clears the form 167ms
🟢 saved addresses › ignores an add with an empty field 147ms
🟢 saved addresses › delete shows its toast but keeps the address, on retry too (planted bug) 164ms
🟢 tests/shadow-dom-form.e2e.ts · 2 passed 501ms
🟢 shadow DOM form › rejects a wrong access code 250ms
🟢 shadow DOM form › grants access with the code from the hint inside the root 251ms
🟢 tests/smoke.e2e.ts · 1 passed 393ms
🟢 home lists the scenarios and opens one 393ms
🟢 tests/stale-dom.e2e.ts · 1 passed 2.2s
🟢 taps the moving target three times across rebuilds of the list 2.2s
🟢 tests/sticky-chrome.e2e.ts · 1 passed 168ms
🟢 accepts the terms once the button clears the sticky footer 168ms
🟢 tests/virtualized-table.e2e.ts · 1 passed 14.6s
🟢 scrolls the windowed table to the Golden Row and claims it 14.6s
🟢 tests/wishlist.e2e.ts · 2 passed 1.4s
🟢 wishlist › saving toggles the button and the tab badge 195ms
🟢 wishlist › the wishlist tab renders the empty state despite the badge count (planted bug) 1.2s

Tested by e2e 0.23.1 · 59.1s · web · run artifacts

@cubic-dev-ai cubic-dev-ai Bot left a comment •

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All reported issues were addressed across 83 files

Heads up: you’ve reached your flex budget. Increase your flex budget or wait for usage to reset.

View guided diff | Turn on auto-fix | Re-trigger cubic

Comment thread packages/e2e/src/collect/select.ts Resolved
@github-actions

github-actions Bot commented Nov 13, 2026 •

Copy link
Copy Markdown
Contributor

🟢 e2e web agent: 34 passed

35 agent steps · 26 replayed from cache · 25 model calls · 117.1k tokens (87% cached) · $0.0065

All 34 tests in 5 files
Test Agent Time
🟢 tests-agent/control-inventory.e2e.ts · 7 passed 7 steps 7.3s
🟢 control inventory › check sets the checkbox and the radio 1 step 648ms
🟢 control inventory › check picks a radio the pick replaces with its summary 1 step 247ms
🟢 control inventory › a long press and a double click are chosen over a plain tap 1 step 885ms
🟢 control inventory › a right-click opens the file menu and Rename renames the file 1 step 2.5s
🟢 control inventory › upload attaches the named project files 1 step 2.4s
🟢 control inventory › back returns from the details view to the inventory 1 step 240ms
🟢 control inventory › scroll_to brings the footnote into view 1 step 345ms
🟢 tests-agent/login-form.e2e.ts · 1 passed 1 step 335ms
🟢 act signs in with the benchmark account 1 step 335ms
🟢 tests-agent/planted-bugs.e2e.ts · 3 passed 4 steps · 8 calls 13.0s
🟢 cart totals: a judgment catches the stale order summary 2 steps · 4 calls 7.3s
🟢 checkout review: a judgment catches the broken copy 1 step · 1 call 1.4s
🟢 wishlist: a judgment catches the lost saved items 1 step · 3 calls 4.3s
🟢 tests-agent/scenarios.e2e.ts · 22 passed 22 steps · 17 calls 1m 14s
🟢 act completes shadow-dom-form 1 step · 4 calls 5.3s
🟢 act completes lying-labels 1 step · 3 calls 5.4s
🟢 act completes iframe-form 1 step · 3 calls 4.0s
🟢 act completes infinite-scroll 1 step 3.2s
🟢 act completes virtualized-table 1 step 15.5s
🟢 act completes overlay-trap 1 step 829ms
🟢 act completes sticky-chrome 1 step 889ms
🟢 act completes async-states 1 step · 3 calls 7.4s
🟢 act completes debounced-search 1 step 2.3s
🟢 act completes hover-menu 1 step 455ms
🟢 act completes drag-and-drop 1 step 414ms
🟢 act completes kanban-board 1 step 584ms
🟢 act completes context-menu-trap 1 step 2.5s
🟢 act completes stale-dom 1 step 416ms
🟢 act completes otp-auto-advance 1 step 662ms
🟢 act completes date-picker 1 step 737ms
🟢 act completes rich-text-editor 1 step 9.8s
🟢 act completes playbook-cleanup 1 step 528ms
🟢 act completes promo-storefront 1 step 2.3s
🟢 act completes new-tab-flow 1 step · 4 calls 8.0s
🟢 act completes gift-card-purchase 1 step 2.4s
🟢 act filters the list and the URL carries the filter 1 step 207ms
🟢 tests-agent/unique-cache.e2e.ts · 1 passed 1 step 255ms
🟢 act adds an address with a run-unique label 1 step 255ms

Tested by e2e 0.23.1 · 1m 35s · web · run artifacts

@github-actions

github-actions Bot commented Nov 13, 2026 •

Copy link
Copy Markdown
Contributor

🟢 e2e ios agent: 1 flaky, 20 passed, 1 skipped

25 agent steps · 12 replayed from cache · 57 model calls · 52.0k tokens (85% cached) · $0.0033

⚠️ 1 flaky test passed on a retry

⚠️ act completes Gestures
tests-agent/scenarios.e2e.ts:266

ASSERTION_FAILED at step 4 of 4: agent.act "Complete this scenario as the screen instructs: long-press the first target, swipe the card left, then double-tap the last target", after 38.9s and 9 model calls

agent.act failed: Long-press and swipe advanced to Step 3. Double-tapped the final target, but the screen remained on Step 3 with “Double-tap the button below”; the scenario did not show completion.

  • Failed the same way on 2 attempts: ASSERTION_FAILED at step 4. The retry that passed is the exception.
  • Turn 6: tap({"target":"n3782"}) → [tap] Tapped #n3782.
  • Turn 7: tap({"target":"n3818"}) → [tap] Tapped #n3818.
  • Turn 8: double_tap({"target":"n3854"}) → [double_tap] Double-tapped #n3854.
  • Screen: dev.e2e.benchmark / Gestures

Evidence: screenshot, log

All 22 tests in 1 file
Test Agent Time
⚠️ tests-agent/scenarios.e2e.ts · 1 flaky, 20 passed, 1 skipped 25 steps · 57 calls 8m 43s
🟢 act completes Login Form 1 step 41.0s
🟢 act completes Infinite Scroll List 1 step 39.1s
🟢 act completes Modal Flow 1 step 11.4s
🟢 act completes Bottom Tabs 1 step 8.4s
🟢 act completes Text Input Variations 1 step 14.7s
🟢 act completes Broken Accessibility 2 steps · 6 calls 30.6s
🟢 act completes Vision Only 2 steps · 6 calls 27.9s
⚠️ act completes Gestures (2 failed attempts first) 1 step · 9 calls 42.5s
🟢 act completes Async States 1 step · 9 calls 35.5s
🟢 act completes Debounced Search 1 step · 1 call 27.8s
🟢 act completes Flattened Registration Form 2 steps · 1 call 26.8s
🟢 act completes Flattened Login 2 steps · 11 calls 58.2s
🟢 act completes Sticky Chrome Target 1 step 13.0s
🟢 act completes WebView Accessibility 1 step 12.2s
🟢 act completes Permission Prompt 1 step 11.7s
🟢 act completes Photo Picker 1 step · 2 calls 27.7s
🟢 act completes Product Catalog 1 step 10.2s
🟢 act completes Error Recovery 1 step 9.6s
🟢 act completes Choice Controls 1 step · 5 calls 33.9s
🟢 act completes Stripe PaymentSheet 1 step · 7 calls 28.9s
🟢 act completes Apple Pay 1 step 11.7s
⏭️ act completes Apple Pay Billing Address (skipped: the CI simulator's Apple Pay sheet skips the billing-address step, so the scenario cannot be completed there)

Tested by e2e 0.23.1 · 10m 12s · ios-simulator · run artifacts

@cubic-dev-ai cubic-dev-ai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

0 issues found across 4 files (changes from recent commits).

Heads up: you’ve reached your flex budget. Increase your flex budget or wait for usage to reset.

View guided diff | Turn on auto-fix | Re-trigger cubic

@github-actions

github-actions Bot commented Nov 13, 2026 •

Copy link
Copy Markdown
Contributor

🟢 e2e android agent: 20 passed

24 agent steps · 15 replayed from cache · 50 model calls · 319.8k tokens (84% cached) · $0.0202

All 20 tests in 1 file
Test Agent Time
🟢 tests-agent/scenarios.e2e.ts · 20 passed 24 steps · 50 calls 6m 4s
🟢 act completes Login Form 1 step 23.1s
🟢 act completes Infinite Scroll List 1 step 20.0s
🟢 act completes Modal Flow 1 step 9.9s
🟢 act completes Bottom Tabs 1 step 6.8s
🟢 act completes Text Input Variations 1 step 6.2s
🟢 act completes Broken Accessibility 2 steps · 6 calls 18.2s
🟢 act completes Vision Only 2 steps · 1 call 6.3s
🟢 act completes Gestures 1 step · 11 calls 27.4s
🟢 act completes Async States 1 step · 20 calls 43.0s
🟢 act completes Debounced Search 1 step 6.8s
🟢 act completes Huge Virtualized List 1 step 1m 49s
🟢 act completes Flattened Registration Form 2 steps · 1 call 7.5s
🟢 act completes Flattened Login 2 steps · 6 calls 14.6s
🟢 act completes Sticky Chrome Target 1 step 9.0s
🟢 act completes WebView Accessibility 1 step · 5 calls 14.7s
🟢 act completes Permission Prompt 1 step 6.3s
🟢 act completes Product Catalog 1 step 8.1s
🟢 act completes Error Recovery 1 step 9.1s
🟢 act completes Choice Controls 1 step 8.2s
🟢 act completes Sequential Onboarding 1 step 9.5s

Tested by e2e 0.23.1 · 6m 4s · android-emulator · run artifacts

@github-actions

github-actions Bot commented Nov 13, 2026 •

Copy link
Copy Markdown
Contributor

🟢 e2e ios: 1 flaky, 55 passed, 1 skipped

⚠️ 1 flaky test passed on a retry

⚠️ device fixture › openLink opens the scenario a deep link names
tests/device-fixture.e2e.ts:111

ASSERTION_FAILED

expect.poll(...).toBe(...) timed out after 10000 ms last: no read completed

  • Screen: dev.e2e.benchmark / Login Form

Evidence: screenshot, log

All 57 tests in 7 files
Test Time
⚠️ tests/device-fixture.e2e.ts · 1 flaky, 11 passed 2m 12s
🟢 device fixture › setAppearance flips the color scheme the app reads 14.3s
🟢 device fixture › setOrientation rotates the window the app measures 8.1s
🟢 device fixture › the clipboard reads back what was written 8.7s
🟢 device fixture › home leaves the app, openApp brings it back where it was 8.2s
🟢 device fixture › closeApp then openApp relaunches on the home list 16.1s
🟢 device fixture › closeApp leaves the next commands on the same device 24.6s
🟢 device fixture › foregroundApp after closeApp reports the closed session as APP_NOT_OPEN 9.7s
⚠️ device fixture › openLink opens the scenario a deep link names (1 failed attempt first) 6.5s
🟢 device fixture › device.back pops the scenario 7.9s
🟢 device fixture › unstable_raw reaches the test session through the raw driver 5.1s
🟢 device fixture › setLocation and clearLocation change what the app reads 11.6s
🟢 device fixture › enrollBiometrics and setBiometrics answer a biometric prompt 11.4s
⏭️ tests/controls.e2e.ts · 23 passed, 1 skipped 3m 30s
🟢 control inventory › a label query resolves a labeled text field 13.5s
🟢 control inventory › a labeled field answers name, display value, value reads, fill, and clear 17.4s
🟢 control inventory › a placeholder query and attribute reads find the field 6.2s
🟢 control inventory › a secure field takes a fill and denies value reads 12.2s
🟢 control inventory › press sends a character and Enter through the soft keyboard 11.8s
🟢 control inventory › a field autofocuses on mount and focus() moves the focus 18.3s
🟢 control inventory › toBeFocused follows the focus 10.7s
🟢 control inventory › a switch checks, unchecks, and reports its state 13.9s
🟢 control inventory › checkbox and radio roles answer getByRole, and a checkbox toggles by tap 9.8s
🟢 control inventory › checkbox and radio roles check, uncheck, and report their state 13.9s
🟢 control inventory › a radio group reports the checked option 9.5s
🟢 control inventory › buttons report disabled, enabled, and a state that arrives later 8.1s
🟢 control inventory › a display: none element is absent rather than hidden, its visible twin attached 8.0s
🟢 control inventory › a header answers its accessible name 4.5s
🟢 control inventory › a tab row answers count, all, texts, filters, positions, and switching 7.1s
🟢 control inventory › a list answers counts, list-form text, reads, and boxes in order 6.9s
⏭️ control inventory › a row contains its texts (skipped: React Native flattens a plain View out of the accessibility tree on both platforms: XCTest and the Android helper report a View with a testID as a leaf beside its children, so filter({ has }) and a query scoped to it match nothing; only Sc…)
🟢 control inventory › a long press lands as one 9.0s
🟢 control inventory › pointer verbs land at the point asked for 10.0s
🟢 control inventory › an ambiguous locator fails at once 5.6s
🟢 control inventory › screenshot, restart, and clearState reopen the app on its home list 11.9s
🟢 refusals › verbs a device never declares are refused before the engine 2ms
🟢 refusals › keys the soft keyboard cannot send are refused by the engine 588ms
🟢 refusals › a missing locator fails as not found once its timeout passes 1.1s
🟢 tests/device.e2e.ts · 3 passed 49.8s
🟢 sequential onboarding echoes the exact values 27.9s
🟢 onboarding rejects a malformed email before advancing 10.3s
🟢 dismissing the keyboard over choice controls leaves them as they were 11.6s
🟢 tests/flows-lists.e2e.ts · 7 passed 4m 7s
🟢 infinite scroll reaches the target item 36.4s
🟢 product catalog adds exactly two of the right variant 10.7s
🟢 gestures: long-press, then swipe left 8.7s
🟢 sticky chrome: accept below the fold, then continue 12.7s
🟢 async states: load, pull to refresh, claim through the toast 11.6s
🟢 huge virtualized list reaches row 512 2m 34s
🟢 web view coupon form applies the code shown on the page 12.1s
🟢 tests/flows.e2e.ts · 7 passed 1m 9s
🟢 text inputs unlock the submit button 12.5s
🟢 filled text inputs report their values 10.4s
🟢 modal flow confirms through the native alert 9.6s
🟢 bottom tabs act inside the last tab 7.6s
🟢 error recovery retries, then confirms the delete 9.3s
🟢 choice controls place the exact order 7.6s
🟢 debounced search selects the target once results arrive 11.5s
🟢 tests/login-form.e2e.ts · 3 passed 45.3s
🟢 login form › rejects a malformed email 13.2s
🟢 login form › rejects an unknown account 12.9s
🟢 login form › signs in and logs out 19.3s
🟢 tests/smoke.e2e.ts · 1 passed 8.3s
🟢 home lists the scenarios and opens one 8.3s

Tested by e2e 0.23.1 · 7m 34s · ios-simulator · run artifacts

@github-actions

github-actions Bot commented Nov 13, 2026 •

Copy link
Copy Markdown
Contributor

🟢 e2e android: 58 passed, 1 skipped

All 59 tests in 7 files
Test Time
⏭️ tests/controls.e2e.ts · 24 passed, 1 skipped 2m 26s
🟢 control inventory › a label query resolves a labeled text field 17.4s
🟢 control inventory › a labeled field answers name, display value, value reads, fill, and clear 10.4s
🟢 control inventory › a placeholder query and attribute reads find the field 4.8s
🟢 control inventory › a secure field takes a fill and denies value reads 5.9s
🟢 control inventory › press sends a character and Enter through the soft keyboard 7.1s
🟢 control inventory › a field autofocuses on mount and focus() moves the focus 6.8s
🟢 control inventory › toBeFocused follows the focus 7.1s
🟢 control inventory › a switch checks, unchecks, and reports its state 7.9s
🟢 control inventory › checkbox and radio roles answer getByRole, and a checkbox toggles by tap 6.4s
🟢 control inventory › checkbox and radio roles check, uncheck, and report their state 9.9s
🟢 control inventory › a tab role answers getByRole 3.6s
🟢 control inventory › a radio group reports the checked option 7.3s
🟢 control inventory › buttons report disabled, enabled, and a state that arrives later 6.3s
🟢 control inventory › a display: none element is absent rather than hidden, its visible twin attached 5.8s
🟢 control inventory › a header answers its accessible name 3.4s
🟢 control inventory › a tab row answers count, all, texts, filters, positions, and switching 5.1s
🟢 control inventory › a list answers counts, list-form text, reads, and boxes in order 4.9s
⏭️ control inventory › a row contains its texts (skipped: React Native flattens a plain View out of the accessibility tree on both platforms: XCTest and the Android helper report a View with a testID as a leaf beside its children, so filter({ has }) and a query scoped to it match nothing; only Sc…)
🟢 control inventory › a long press lands as one 6.7s
🟢 control inventory › a double tap lands inside the 300 ms window 6.1s
🟢 control inventory › an ambiguous locator fails at once 4.5s
🟢 control inventory › screenshot, restart, and clearState reopen the app on its home list 5.8s
🟢 refusals › verbs a device never declares are refused before the engine 2ms
🟢 refusals › keys the soft keyboard cannot send are refused by the engine 1.6s
🟢 refusals › a missing locator fails as not found once its timeout passes 1.1s
🟢 tests/device-fixture.e2e.ts · 11 passed 1m 13s
🟢 device fixture › setOrientation rotates the window the app measures 4.6s
🟢 device fixture › home leaves the app, openApp brings it back where it was 3.4s
🟢 device fixture › foregroundApp sees the home screen after home() 3.8s
🟢 device fixture › closeApp then openApp relaunches on the home list 5.7s
🟢 device fixture › closeApp leaves the next commands on the same device 5.6s
🟢 device fixture › foregroundApp after closeApp reports the closed session as APP_NOT_OPEN 3.9s
🟢 device fixture › openLink opens the scenario a deep link names 4.1s
🟢 device fixture › device.back pops the scenario 3.9s
🟢 device fixture › unstable_raw reaches the test session through the raw driver 3.3s
🟢 device fixture › setNetwork and setAirplaneMode change what the app sees 14.5s
🟢 device fixture › setLocation and clearLocation change what the app reads 19.8s
🟢 tests/device.e2e.ts · 5 passed 34.5s
🟢 permission prompt › allowing the system dialog enables the microphone 5.0s
🟢 permission prompt › a denied prompt recovers once the permission is granted outside 10.2s
🟢 sequential onboarding echoes the exact values 8.7s
🟢 onboarding rejects a malformed email before advancing 5.1s
🟢 dismissing the keyboard over choice controls leaves them as they were 5.6s
🟢 tests/flows-lists.e2e.ts · 7 passed 3m 0s
🟢 infinite scroll reaches the target item 27.1s
🟢 product catalog adds exactly two of the right variant 7.9s
🟢 gestures: long-press, then swipe left 7.3s
🟢 gestures: double-tap completes the flow 9.0s
🟢 sticky chrome: accept below the fold, then continue 10.1s
🟢 async states: load, pull to refresh, claim through the toast 11.2s
🟢 huge virtualized list reaches row 512 1m 47s
🟢 tests/flows.e2e.ts · 7 passed 45.6s
🟢 text inputs unlock the submit button 5.5s
🟢 filled text inputs report their values 5.0s
🟢 modal flow confirms through the native alert 7.7s
🟢 bottom tabs act inside the last tab 6.0s
🟢 error recovery retries, then confirms the delete 8.0s
🟢 choice controls place the exact order 5.6s
🟢 debounced search selects the target once results arrive 7.8s
🟢 tests/login-form.e2e.ts · 3 passed 24.7s
🟢 login form › rejects a malformed email 6.6s
🟢 login form › rejects an unknown account 6.4s
🟢 login form › signs in and logs out 11.6s
🟢 tests/smoke.e2e.ts · 1 passed 4.8s
🟢 home lists the scenarios and opens one 4.8s

Tested by e2e 0.23.1 · 8m 29s · android-emulator · run artifacts

kdy1 and others added 2 commits November 15, 2026 17:49
TargetExecutor's engine init, dispose, and per-attempt session launch and
close move to an EngineSessions base class. The standalone worker takes a
WorkerPolicy and an AttemptPolicy per kind; the hosted and one-shot kinds
live in standalone-kinds.ts. resolveProjectConfig resolves what is not
reporters or test filters, which resolveConfig in config/resolve-run.ts
adds, with their types in run-types.ts. No behavior changes: this is the
seam the next change moves into a package of its own.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
collect/select.ts read it from run/provision.ts, which loads app processes
and engine provisioning; internal/recording-modes.ts already holds the
modes it resolves.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@okwasniewski
okwasniewski added this pull request to the merge queue Nov 15, 2026
Merged via the queue into main with commit 9949c8a Nov 15, 2026
33 checks passed
@okwasniewski
okwasniewski deleted the kdy1/e2e-core-1-split branch November 15, 2026 18:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size:XXL 1,000+ changed lines, not counting tests, fixtures, or the lockfile

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants