Skip to content

chore(deps): bump agent-device and @agent-device/testmu to 0.21.35 - #1458

Merged
kacperkapusciak merged 2 commits into
mainfrom
t3/bump-agent-device-0-21-35
Oct 30, 2026
Merged

kacperkapusciak merged 2 commits into
mainfrom
t3/bump-agent-device-0-21-35

Conversation

@kacperkapusciak

@kacperkapusciak kacperkapusciak commented Oct 30, 2026 •

Copy link
Copy Markdown
Member
  • Moves agent-device from 0.21.34 to 0.21.35 in @e2e-dev/mobile, @e2e-dev/limrun, @e2e-dev/testmu, and the docs workspace.
  • Moves @agent-device/testmu from 0.21.33 to 0.21.35. chore(deps): bump agent-device to 0.21.34 #1449 left it behind.
  • User-visible upstream changes: when no device is named, booting picks the newest of several shut-down devices (callstack/agent-device#4042), and on iOS, pressing return with nothing focused keeps the runner session (callstack/agent-device#4032). Full notes: v0.21.35.
  • The lockfile diff touches only these two packages.

Verified

Ran it locally: yes

  • Unit tests for mobile (447), limrun (17), and testmu (102) pass on 0.21.35, including the golden device tree projection.
  • Mobile benchmark deterministic suite on an iOS 27 simulator (iPhone 17 Pro), built packages, pnpm --filter @e2e-dev/mobile-benchmark run test --target ios-simulator: 55 passed, 1 skipped, 2 failed.
  • The 2 failures are refusals > keys the soft keyboard cannot send... and refusals > a missing locator fails..., both APP_NOT_OPEN on the first step. They fail the same way with agent-device 0.21.34, and they pass in this PR's CI ios deterministic job, so they come from this Mac, not the bump:
controls.e2e.ts --grep refusals, local agent-device 0.21.34 agent-device 0.21.35
verbs a device never declares passed passed
keys the soft keyboard cannot send APP_NOT_OPEN APP_NOT_OPEN
a missing locator fails as not found APP_NOT_OPEN APP_NOT_OPEN
  • Android emulator: not run locally. CI's Android suites cover it.

@github-actions github-actions Bot added the size:S Up to 29 changed lines, not counting tests, fixtures, or the lockfile label Oct 30, 2026

@cubic-dev-ai cubic-dev-ai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No issues found across 6 files

View guided diff | Turn on auto-fix | Re-trigger cubic

@github-actions

Copy link
Copy Markdown
Contributor

🟢 e2e web: 91 passed

All 91 tests in 41 files
Test Time
🟢 tests/aria-hidden-flow.e2e.ts · 2 passed 811ms
🟢 aria hidden flow › picks the Pro plan by its visible text and confirms it 559ms
🟢 aria hidden flow › another plan shows the error and keeps the picker open 252ms
🟢 tests/async-states.e2e.ts · 2 passed 7.3s
🟢 async states › reads the code off the transient toast and verifies it once the button enables 2.4s
🟢 async states › a wrong code is rejected after the toast has gone 4.9s
🟢 tests/canvas-only.e2e.ts · 2 passed 513ms
🟢 canvas only › taps square, circle, then diamond at their pixel coordinates 268ms
🟢 canvas only › a shape out of order paints the error and resets progress 245ms
🟢 tests/canvas-whiteboard.e2e.ts · 2 passed 636ms
🟢 canvas whiteboard › drags both shapes into their slots and saves 359ms
🟢 canvas whiteboard › bounces a shape off the wrong slot and refuses to save early 277ms
🟢 tests/cart-totals.e2e.ts · 2 passed 631ms
🟢 cart totals › increasing a quantity updates the line total but the order summary stays stale (planted bug) 357ms
🟢 cart totals › a quantity never drops below one 274ms
🟢 tests/checkout-review.e2e.ts · 1 passed 275ms
🟢 shows a raw greeting token and an undefined delivery date (planted bug), yet places the order 275ms
🟢 tests/context-menu-trap.e2e.ts · 2 passed 1.0s
🟢 context menu trap › right-click opens nothing; the row menu renames the file 503ms
🟢 context menu trap › the decoy menu items refuse and keep the file 512ms
🟢 tests/control-inventory.e2e.ts · 8 passed 4.8s
🟢 control inventory › check sets the checkbox and the radio without flipping a set one 549ms
🟢 control inventory › check picks a radio the pick replaces with its summary 332ms
🟢 control inventory › a long press and a double click are told apart from a tap 1.2s
🟢 control inventory › the file menu opens on right-click only and Rename renames the file 448ms
🟢 control inventory › setInputFiles attaches files named from the project root 287ms
🟢 control inventory › the details view is left through the browser history 332ms
🟢 control inventory › scrollIntoView brings the footnote into view 235ms
🟢 control inventory › every exercise done shows the success message 1.5s
🟢 tests/css-content-ui.e2e.ts · 2 passed 517ms
🟢 css content ui › the tile labelled Ship it advances and confirming ships 284ms
🟢 css content ui › a wrong tile shows the CSS-rendered error and keeps the picker 233ms
🟢 tests/date-picker.e2e.ts · 2 passed 1.2s
🟢 date picker › navigates three months ahead and books the required date 685ms
🟢 date picker › confirming without the exact date shows the error 467ms
🟢 tests/debounced-search.e2e.ts · 2 passed 3.4s
🟢 debounced search › a decoy one character off is refused 1.6s
🟢 debounced search › picking the exact item adds it to the cart 1.7s
🟢 tests/deferred-dialog.e2e.ts · 1 passed 1.3s
🟢 one submit opens one confirm, even when double-clicked 1.3s
🟢 tests/div-soup.e2e.ts · 2 passed 1.4s
🟢 div soup › a wrong code is rejected 597ms
🟢 div soup › the right code grants access after the delete tile fixes a typo 833ms
🟢 tests/drag-and-drop.e2e.ts · 2 passed 1.2s
🟢 drag and drop › an out-of-order item resets the dropzone 610ms
🟢 drag and drop › dropping Banana then Cherry passes 636ms
🟢 tests/filter-deep-link.e2e.ts · 2 passed 549ms
🟢 filter deep link › filtering writes the query to the URL 308ms
🟢 filter deep link › opening a shared link restores the filter 241ms
🟢 tests/gift-card-purchase.e2e.ts · 3 passed 1.8s
🟢 gift card purchase › refuses to buy without an amount 418ms
🟢 gift card purchase › refuses a recipient without an at sign 604ms
🟢 gift card purchase › sends the gift card 733ms
🟢 tests/hover-menu.e2e.ts · 2 passed 1.1s
🟢 hover menu › a decoy leaf is refused 456ms
🟢 hover menu › hovering Account, then Billing, reaches Redeem voucher 642ms
🟢 tests/iframe-form.e2e.ts · 2 passed 1.7s
🟢 iframe form › a wrong code is refused by the host page 701ms
🟢 iframe form › the code read from one frame applies through the other 973ms
🟢 tests/image-only-ui.e2e.ts · 3 passed 1.7s
🟢 image only ui › the icons have no names, so the bare svg locator is ambiguous 260ms
🟢 image only ui › a wrong icon shows the error image and keeps the icons 659ms
🟢 image only ui › tapping the star, then the heart, verifies the icons 809ms
🟢 tests/infinite-scroll.e2e.ts · 1 passed 4.8s
🟢 scrolls the feed until the Golden Ticket loads, then claims it 4.8s
🟢 tests/kanban-board.e2e.ts · 3 passed 1.4s
🟢 kanban board › pointer drags move both cards into the goal layout 596ms
🟢 kanban board › a swipe along a path drags a card as well 342ms
🟢 kanban board › a plain tap moves nothing and the untouched board is rejected 478ms
🟢 tests/login-form.e2e.ts · 4 passed 1.6s
🟢 login form › rejects a malformed email 478ms
🟢 login form › rejects a short password 372ms
🟢 login form › rejects an unknown account 372ms
🟢 login form › signs in and logs out 419ms
🟢 tests/lying-labels.e2e.ts · 4 passed 1.2s
🟢 lying labels › the button whose accessible name says Pay now is the wrong one 289ms
🟢 lying labels › a text match for Pay now catches the decoy phrase too 175ms
🟢 lying labels › the field whose accessible name says Amount is the wrong one 385ms
🟢 lying labels › visible text drives the payment through 382ms
🟢 tests/native-dialogs.e2e.ts · 3 passed 1.2s
🟢 native dialogs › answers the confirm, prompt, and alert chain 336ms
🟢 native dialogs › dismissing the confirm cancels the order 409ms
🟢 native dialogs › a wrong gift code is rejected 417ms
🟢 tests/newsletter-signup.e2e.ts · 1 passed 2.6s
🟢 subscribe renders no feedback and logs a TypeError (planted bug) 2.6s
🟢 tests/onboarding-wizard.e2e.ts · 5 passed 11.5s
🟢 onboarding wizard › back keeps what was typed and the brief comes back with it 991ms
🟢 onboarding wizard › the address step takes the brief through its bare-div dropdown 1.2s
🟢 onboarding wizard › the profile step steers the calendar three decades back 4.0s
🟢 onboarding wizard › the preferences step flips the toggles the brief names and leaves the trap off 2.7s
🟢 onboarding wizard › the review step repeats the brief and finishes with the PIN 2.5s
🟢 tests/order-history.e2e.ts · 2 passed 1.9s
🟢 order history › overview and settings render their panels 345ms
🟢 order history › the orders tab never leaves its loading state (planted bug) 1.5s
🟢 tests/otp-auto-advance.e2e.ts · 3 passed 2.3s
🟢 otp auto-advance › focus advances with each digit and the full code verifies 881ms
🟢 otp auto-advance › backspace on an empty box clears and refocuses the previous one 386ms
🟢 otp auto-advance › a wrong code clears every box and starts over 1.1s
🟢 tests/overlay-trap.e2e.ts · 1 passed 847ms
🟢 continues only after the banner and the overlay are gone 847ms
🟢 tests/playbook-cleanup.e2e.ts · 2 passed 994ms
🟢 playbook cleanup › deleting the draft removes it from an exact-name search 468ms
🟢 playbook cleanup › cancelling the dialog keeps the draft searchable 526ms
🟢 tests/price-sorting.e2e.ts · 3 passed 1.1s
🟢 price sorting › opens in the featured order with sale prices struck through 272ms
🟢 price sorting › low to high sorts by the original price, not the paid one (planted bug) 325ms
🟢 price sorting › high to low is the same wrong order reversed (planted bug) 492ms
🟢 tests/product-reviews.e2e.ts · 1 passed 1.5s
🟢 the running-shoe page lists coffee-grinder reviews (planted bug) 1.5s
🟢 tests/promo-storefront.e2e.ts · 1 passed 1.6s
🟢 buys a deal once the promo chrome is out of the way 1.6s
🟢 tests/rich-text-editor.e2e.ts · 2 passed 1.1s
🟢 rich text editor › bolding exactly the required word passes the check 561ms
🟢 rich text editor › bold that spills into the previous word fails the check 518ms
🟢 tests/saved-addresses.e2e.ts · 3 passed 1.1s
🟢 saved addresses › adds an address and clears the form 411ms
🟢 saved addresses › ignores an add with an empty field 410ms
🟢 saved addresses › delete shows its toast but keeps the address, on retry too (planted bug) 315ms
🟢 tests/shadow-dom-form.e2e.ts · 2 passed 695ms
🟢 shadow DOM form › rejects a wrong access code 289ms
🟢 shadow DOM form › grants access with the code from the hint inside the root 406ms
🟢 tests/smoke.e2e.ts · 1 passed 438ms
🟢 home lists the scenarios and opens one 438ms
🟢 tests/stale-dom.e2e.ts · 1 passed 2.4s
🟢 taps the moving target three times across rebuilds of the list 2.4s
🟢 tests/sticky-chrome.e2e.ts · 1 passed 382ms
🟢 accepts the terms once the button clears the sticky footer 382ms
🟢 tests/virtualized-table.e2e.ts · 1 passed 40.2s
🟢 scrolls the windowed table to the Golden Row and claims it 40.2s
🟢 tests/wishlist.e2e.ts · 2 passed 2.5s
🟢 wishlist › saving toggles the button and the tab badge 846ms
🟢 wishlist › the wishlist tab renders the empty state despite the badge count (planted bug) 1.7s

e2e 0.21.3 · 1m 56s · web · run artifacts

@github-actions

Copy link
Copy Markdown
Contributor

🟢 e2e web agent: 33 passed

35 agent steps · 26 replayed from cache · 21 model calls · 86.5k tokens (84% cached) · $0.0057

All 33 tests in 5 files
Test Agent Time
🟢 tests-agent/control-inventory.e2e.ts · 7 passed 7 steps 7.7s
🟢 control inventory › check sets the checkbox and the radio 1 step 619ms
🟢 control inventory › check picks a radio the pick replaces with its summary 1 step 297ms
🟢 control inventory › a long press and a double click are chosen over a plain tap 1 step 960ms
🟢 control inventory › a right-click opens the file menu and Rename renames the file 1 step 2.6s
🟢 control inventory › upload attaches the named project files 1 step 2.5s
🟢 control inventory › back returns from the details view to the inventory 1 step 377ms
🟢 control inventory › scroll_to brings the footnote into view 1 step 425ms
🟢 tests-agent/login-form.e2e.ts · 1 passed 1 step 362ms
🟢 act signs in with the benchmark account 1 step 362ms
🟢 tests-agent/planted-bugs.e2e.ts · 3 passed 5 steps · 9 calls 16.2s
🟢 cart totals: a judgment catches the stale order summary 2 steps · 4 calls 7.8s
🟢 checkout review: a judgment catches the broken copy 1 step · 1 call 1.9s
🟢 wishlist: a judgment catches the lost saved items 2 steps · 4 calls 6.5s
🟢 tests-agent/scenarios.e2e.ts · 21 passed 21 steps · 12 calls 1m 54s
🟢 act completes shadow-dom-form 1 step · 3 calls 5.1s
🟢 act completes lying-labels 1 step · 3 calls 4.8s
🟢 act completes iframe-form 1 step · 3 calls 6.1s
🟢 act completes infinite-scroll 1 step 6.0s
🟢 act completes virtualized-table 1 step 58.8s
🟢 act completes overlay-trap 1 step 917ms
🟢 act completes sticky-chrome 1 step 1.0s
🟢 act completes async-states 1 step · 3 calls 7.0s
🟢 act completes debounced-search 1 step 2.3s
🟢 act completes hover-menu 1 step 556ms
🟢 act completes drag-and-drop 1 step 489ms
🟢 act completes kanban-board 1 step 710ms
🟢 act completes context-menu-trap 1 step 2.7s
🟢 act completes stale-dom 1 step 555ms
🟢 act completes otp-auto-advance 1 step 822ms
🟢 act completes date-picker 1 step 1.0s
🟢 act completes rich-text-editor 1 step 10.5s
🟢 act completes playbook-cleanup 1 step 634ms
🟢 act completes promo-storefront 1 step 1.3s
🟢 act completes gift-card-purchase 1 step 2.5s
🟢 act filters the list and the URL carries the filter 1 step 256ms
🟢 tests-agent/unique-cache.e2e.ts · 1 passed 1 step 367ms
🟢 act adds an address with a run-unique label 1 step 367ms

e2e 0.21.3 · 2m 19s · web · run artifacts

@github-actions

Copy link
Copy Markdown
Contributor

🟢 e2e android agent: 20 passed

24 agent steps · 15 replayed from cache · 43 model calls · 273.0k tokens (78% cached) · $0.0214

All 20 tests in 1 file
Test Agent Time
🟢 tests-agent/scenarios.e2e.ts · 20 passed 24 steps · 43 calls 6m 8s
🟢 act completes Login Form 1 step 32.6s
🟢 act completes Infinite Scroll List 1 step 26.4s
🟢 act completes Modal Flow 1 step 13.3s
🟢 act completes Bottom Tabs 1 step 8.1s
🟢 act completes Text Input Variations 1 step 8.8s
🟢 act completes Broken Accessibility 2 steps · 6 calls 23.5s
🟢 act completes Vision Only 2 steps · 1 call 9.1s
🟢 act completes Gestures 1 step · 9 calls 28.0s
🟢 act completes Async States 1 step · 16 calls 48.8s
🟢 act completes Debounced Search 1 step 7.2s
🟢 act completes Huge Virtualized List 1 step 1m 6s
🟢 act completes Flattened Registration Form 2 steps · 1 call 8.7s
🟢 act completes Flattened Login 2 steps · 6 calls 19.7s
🟢 act completes Sticky Chrome Target 1 step 7.8s
🟢 act completes WebView Accessibility 1 step · 4 calls 15.1s
🟢 act completes Permission Prompt 1 step 6.8s
🟢 act completes Product Catalog 1 step 8.7s
🟢 act completes Error Recovery 1 step 9.6s
🟢 act completes Choice Controls 1 step 9.2s
🟢 act completes Sequential Onboarding 1 step 10.0s

e2e 0.21.3 · 6m 8s · android-emulator · run artifacts

@github-actions

Copy link
Copy Markdown
Contributor

🟢 e2e ios: 55 passed, 1 skipped

All 56 tests in 7 files
Test Time
⏭️ tests/controls.e2e.ts · 23 passed, 1 skipped 3m 6s
🟢 control inventory › a label query resolves a labeled text field 13.9s
🟢 control inventory › a labeled field answers name, display value, value reads, fill, and clear 15.7s
🟢 control inventory › a placeholder query and attribute reads find the field 4.7s
🟢 control inventory › a secure field takes a fill and denies value reads 8.6s
🟢 control inventory › press sends a character and Enter through the soft keyboard 9.9s
🟢 control inventory › a field autofocuses on mount and focus() moves the focus 11.0s
🟢 control inventory › toBeFocused follows the focus 9.0s
🟢 control inventory › a switch checks, unchecks, and reports its state 9.8s
🟢 control inventory › checkbox and radio roles answer getByRole, and a checkbox toggles by tap 8.1s
🟢 control inventory › checkbox and radio roles check, uncheck, and report their state 13.1s
🟢 control inventory › a radio group reports the checked option 9.5s
🟢 control inventory › buttons report disabled, enabled, and a state that arrives later 8.1s
🟢 control inventory › a display: none element is absent rather than hidden, its visible twin attached 7.6s
🟢 control inventory › a header answers its accessible name 4.6s
🟢 control inventory › a tab row answers count, all, texts, filters, positions, and switching 6.4s
🟢 control inventory › a list answers counts, list-form text, reads, and boxes in order 7.0s
⏭️ control inventory › a row contains its texts (skipped: React Native flattens a plain View out of the accessibility tree on both platforms: XCTest and the Android helper report a View with a testID as a leaf beside its children, so filter({ has }) and a query scoped to it match nothing; only Sc…)
🟢 control inventory › a long press lands as one 8.5s
🟢 control inventory › pointer verbs land at the point asked for 10.7s
🟢 control inventory › an ambiguous locator fails at once 6.1s
🟢 control inventory › screenshot, restart, and clearState reopen the app on its home list 12.1s
🟢 refusals › verbs a device never declares are refused before the engine 2ms
🟢 refusals › keys the soft keyboard cannot send are refused by the engine 395ms
🟢 refusals › a missing locator fails as not found once its timeout passes 1.1s
🟢 tests/device-fixture.e2e.ts · 11 passed 1m 36s
🟢 device fixture › setAppearance flips the color scheme the app reads 17.9s
🟢 device fixture › setOrientation rotates the window the app measures 9.4s
🟢 device fixture › the clipboard reads back what was written 6.2s
🟢 device fixture › home leaves the app, openApp brings it back where it was 6.3s
🟢 device fixture › closeApp then openApp relaunches on the home list 8.3s
🟢 device fixture › closeApp leaves the next commands on the same device 11.2s
🟢 device fixture › foregroundApp after closeApp reports the closed session as APP_NOT_OPEN 6.6s
🟢 device fixture › device.back pops the scenario 5.6s
🟢 device fixture › unstable_raw reaches the test session through agent-device 4.4s
🟢 device fixture › setLocation and clearLocation change what the app reads 10.2s
🟢 device fixture › enrollBiometrics and setBiometrics answer a biometric prompt 10.4s
🟢 tests/device.e2e.ts · 3 passed 1m 9s
🟢 sequential onboarding echoes the exact values 42.9s
🟢 onboarding rejects a malformed email before advancing 14.1s
🟢 dismissing the keyboard over choice controls leaves them as they were 12.5s
🟢 tests/flows-lists.e2e.ts · 7 passed 3m 16s
🟢 infinite scroll reaches the target item 25.1s
🟢 product catalog adds exactly two of the right variant 10.6s
🟢 gestures: long-press, then swipe left 9.3s
🟢 sticky chrome: accept below the fold, then continue 10.3s
🟢 async states: load, pull to refresh, claim through the toast 11.1s
🟢 huge virtualized list reaches row 512 1m 57s
🟢 web view coupon form applies the code shown on the page 11.9s
🟢 tests/flows.e2e.ts · 7 passed 1m 10s
🟢 text inputs unlock the submit button 13.9s
🟢 filled text inputs report their values 10.5s
🟢 modal flow confirms through the native alert 9.8s
🟢 bottom tabs act inside the last tab 7.4s
🟢 error recovery retries, then confirms the delete 9.9s
🟢 choice controls place the exact order 7.7s
🟢 debounced search selects the target once results arrive 11.3s
🟢 tests/login-form.e2e.ts · 3 passed 50.2s
🟢 login form › rejects a malformed email 13.7s
🟢 login form › rejects an unknown account 13.7s
🟢 login form › signs in and logs out 22.8s
🟢 tests/smoke.e2e.ts · 1 passed 8.0s
🟢 home lists the scenarios and opens one 8.0s

e2e 0.21.3 · 6m 2s · ios-simulator · run artifacts

@github-actions

Copy link
Copy Markdown
Contributor

🟢 e2e android: 57 passed, 1 skipped

All 58 tests in 7 files
Test Time
⏭️ tests/controls.e2e.ts · 24 passed, 1 skipped 3m 19s
🟢 control inventory › a label query resolves a labeled text field 30.7s
🟢 control inventory › a labeled field answers name, display value, value reads, fill, and clear 16.0s
🟢 control inventory › a placeholder query and attribute reads find the field 7.5s
🟢 control inventory › a secure field takes a fill and denies value reads 11.5s
🟢 control inventory › press sends a character and Enter through the soft keyboard 11.0s
🟢 control inventory › a field autofocuses on mount and focus() moves the focus 9.7s
🟢 control inventory › toBeFocused follows the focus 9.2s
🟢 control inventory › a switch checks, unchecks, and reports its state 10.0s
🟢 control inventory › checkbox and radio roles answer getByRole, and a checkbox toggles by tap 7.8s
🟢 control inventory › checkbox and radio roles check, uncheck, and report their state 11.3s
🟢 control inventory › a tab role answers getByRole 4.4s
🟢 control inventory › a radio group reports the checked option 7.8s
🟢 control inventory › buttons report disabled, enabled, and a state that arrives later 7.3s
🟢 control inventory › a display: none element is absent rather than hidden, its visible twin attached 7.0s
🟢 control inventory › a header answers its accessible name 4.6s
🟢 control inventory › a tab row answers count, all, texts, filters, positions, and switching 6.1s
🟢 control inventory › a list answers counts, list-form text, reads, and boxes in order 6.2s
⏭️ control inventory › a row contains its texts (skipped: React Native flattens a plain View out of the accessibility tree on both platforms: XCTest and the Android helper report a View with a testID as a leaf beside its children, so filter({ has }) and a query scoped to it match nothing; only Sc…)
🟢 control inventory › a long press lands as one 7.4s
🟢 control inventory › a double tap lands inside the 300 ms window 7.0s
🟢 control inventory › an ambiguous locator fails at once 5.4s
🟢 control inventory › screenshot, restart, and clearState reopen the app on its home list 9.1s
🟢 refusals › verbs a device never declares are refused before the engine 3ms
🟢 refusals › keys the soft keyboard cannot send are refused by the engine 1.2s
🟢 refusals › a missing locator fails as not found once its timeout passes 1.1s
🟢 tests/device-fixture.e2e.ts · 10 passed 1m 26s
🟢 device fixture › setOrientation rotates the window the app measures 6.0s
🟢 device fixture › home leaves the app, openApp brings it back where it was 5.3s
🟢 device fixture › foregroundApp sees the home screen after home() 4.4s
🟢 device fixture › closeApp then openApp relaunches on the home list 10.0s
🟢 device fixture › closeApp leaves the next commands on the same device 8.4s
🟢 device fixture › foregroundApp after closeApp reports the closed session as APP_NOT_OPEN 4.8s
🟢 device fixture › device.back pops the scenario 5.2s
🟢 device fixture › unstable_raw reaches the test session through agent-device 4.2s
🟢 device fixture › setNetwork and setAirplaneMode change what the app sees 16.1s
🟢 device fixture › setLocation and clearLocation change what the app reads 21.6s
🟢 tests/device.e2e.ts · 5 passed 43.8s
🟢 permission prompt › allowing the system dialog enables the microphone 6.5s
🟢 permission prompt › a denied prompt recovers once the permission is granted outside 13.9s
🟢 sequential onboarding echoes the exact values 10.2s
🟢 onboarding rejects a malformed email before advancing 5.9s
🟢 dismissing the keyboard over choice controls leaves them as they were 7.2s
🟢 tests/flows-lists.e2e.ts · 7 passed 2m 6s
🟢 infinite scroll reaches the target item 18.5s
🟢 product catalog adds exactly two of the right variant 9.0s
🟢 gestures: long-press, then swipe left 8.2s
🟢 gestures: double-tap completes the flow 10.0s
🟢 sticky chrome: accept below the fold, then continue 9.4s
🟢 async states: load, pull to refresh, claim through the toast 12.0s
🟢 huge virtualized list reaches row 512 59.3s
🟢 tests/flows.e2e.ts · 7 passed 50.4s
🟢 text inputs unlock the submit button 6.3s
🟢 filled text inputs report their values 5.7s
🟢 modal flow confirms through the native alert 9.0s
🟢 bottom tabs act inside the last tab 6.6s
🟢 error recovery retries, then confirms the delete 8.6s
🟢 choice controls place the exact order 5.9s
🟢 debounced search selects the target once results arrive 8.3s
🟢 tests/login-form.e2e.ts · 3 passed 27.4s
🟢 login form › rejects a malformed email 7.5s
🟢 login form › rejects an unknown account 7.3s
🟢 login form › signs in and logs out 12.6s
🟢 tests/smoke.e2e.ts · 1 passed 5.4s
🟢 home lists the scenarios and opens one 5.4s

e2e 0.21.3 · 9m 0s · android-emulator · run artifacts

@github-actions

Copy link
Copy Markdown
Contributor

🟢 e2e ios agent: 21 passed, 1 skipped

25 agent steps · 6 replayed from cache · 70 model calls · 451.5k tokens (82% cached) · $0.0310

All 22 tests in 1 file
Test Agent Time
⏭️ tests-agent/scenarios.e2e.ts · 21 passed, 1 skipped 25 steps · 70 calls 11m 35s
🟢 act completes Login Form 1 step 39.9s
🟢 act completes Infinite Scroll List 1 step · 1 call 42.8s
🟢 act completes Modal Flow 1 step · 1 call 25.6s
🟢 act completes Bottom Tabs 1 step · 1 call 23.4s
🟢 act completes Text Input Variations 1 step · 4 calls 36.4s
🟢 act completes Broken Accessibility 2 steps · 8 calls 47.5s
🟢 act completes Vision Only 2 steps · 6 calls 45.1s
🟢 act completes Gestures 1 step · 7 calls 30.2s
🟢 act completes Async States 1 step · 7 calls 22.7s
🟢 act completes Debounced Search 1 step · 1 call 28.5s
🟢 act completes Flattened Registration Form 2 steps · 1 call 28.8s
🟢 act completes Flattened Login 2 steps · 15 calls 1m 29s
🟢 act completes Sticky Chrome Target 1 step · 2 calls 1m 2s
🟢 act completes WebView Accessibility 1 step 12.4s
🟢 act completes Permission Prompt 1 step 11.2s
🟢 act completes Photo Picker 1 step · 2 calls 29.6s
🟢 act completes Product Catalog 1 step 10.1s
🟢 act completes Error Recovery 1 step 9.5s
🟢 act completes Choice Controls 1 step · 6 calls 37.3s
🟢 act completes Stripe PaymentSheet 1 step · 7 calls 30.2s
🟢 act completes Apple Pay 1 step · 1 call 32.5s
⏭️ act completes Apple Pay Billing Address (skipped: the CI simulator's Apple Pay sheet skips the billing-address step, so the scenario cannot be completed there)

e2e 0.21.3 · 11m 36s · ios-simulator · run artifacts

@kacperkapusciak
kacperkapusciak added this pull request to the merge queue Oct 30, 2026
Merged via the queue into main with commit 450be72 Oct 30, 2026
39 of 41 checks passed
@kacperkapusciak
kacperkapusciak deleted the t3/bump-agent-device-0-21-35 branch October 30, 2026 09:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Ready for Human Review size:S Up to 29 changed lines, not counting tests, fixtures, or the lockfile

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant