Skip to content

feat(firefox): roll to r1569 - #43710

Merged
Dmitry Gozman (dgozman) merged 1 commit into
mainfrom
roll-into-pw-firefox/1569
Oct 28, 2026
Merged

Dmitry Gozman (dgozman) merged 1 commit into
mainfrom
roll-into-pw-firefox/1569

Conversation

@microsoft-playwright-automation

Copy link
Copy Markdown
Contributor

Browser build: https://github.com/microsoft/playwright-browsers/commit/4fca4176a120c508f3591ce1fb710609b3913129. Build has full platform coverage - check that all tests pass there.

@github-actions

Copy link
Copy Markdown
Contributor

Test results for "MCP"

5189 passed, 614 skipped


Merge workflow run.

@github-actions

Copy link
Copy Markdown
Contributor

Test results for "tests 1"

23576 passed, 706 skipped


Merge workflow run.

@github-actions

Copy link
Copy Markdown
Contributor

Test results for "tests 2"

1 fatal errors, not part of any test
14 failed
❌ [chromium-library] › library/chromium/connect-over-cdp.spec.ts:202 › CD-007 should write traces to provided artifactsDir on connectOverCDP @msedge-dev-playwright-x64-server2025-64-core
❌ [chromium-library] › library/downloads-path.spec.ts:91 › downloads path › DO-043 should accept downloads in persistent context @msedge-dev-playwright-x64-server2025-64-core
❌ [chromium-library] › library/chromium/connect-over-cdp.spec.ts:333 › CD-011 should connect to existing service workers @msedge-playwright-x64-server2025-64-core
❌ [firefox-library] › library/inspector/cli-codegen-aria.spec.ts:87 › CG-100 should update aria snapshot highlight @firefox-macos-15-large
❌ [firefox-library] › library/browsercontext-reuse.spec.ts:200 › reuse launch › BC-076 should not cache resources @firefox-playwright-x64-server2025-64-core
❌ [firefox-library] › library/browsercontext-reuse.spec.ts:361 › reuse launch › BC-082 should work with routeWebSocket @firefox-playwright-x64-server2025-64-core
❌ [firefox-library] › library/browsercontext-storage-state.spec.ts:119 › ST-004 should round-trip through the file @firefox-playwright-x64-server2025-64-core
❌ [firefox-library] › library/browsercontext-storage-state.spec.ts:203 › ST-005 should round-trip OPFS @firefox-playwright-x64-server2025-64-core
❌ [firefox-library] › library/browsercontext-storage-state.spec.ts:545 › ST-016 should support IndexedDB @firefox-playwright-x64-server2025-64-core
❌ [android-page] › page/page-event-pageerror.spec.ts:20 › ER-001 should fire
❌ [android-page] › page/selectors-get-by.spec.ts:117 › SE-082 getByLabel should work with aria-labelledby
❌ [android-page] › page/selectors-get-by.spec.ts:122 › SE-083 getByLabel should prioritize aria-labelledby over native label
❌ [android-page] › page/selectors-get-by.spec.ts:140 › SE-086 getByLabel should prioritize aria-labelledby over aria-label
❌ [android-page] › page/selectors-role.spec.ts:436 › SE-060 should support name

59 flaky ⚠️ [chromium-library] › library/chromium/connect-over-cdp.spec.ts:202 › CD-007 should write traces to provided artifactsDir on connectOverCDP `@chromium-playwright-x64-server2025-64-core`
⚠️ [chromium-library] › library/video.spec.ts:762 › screencast › VI-030 should work with video+trace `@chromium-playwright-x64-server2025-64-core`
⚠️ [chromium-library] › library/chromium/connect-over-cdp.spec.ts:45 › CD-002 should connect when an existing page has no renderer `@msedge-dev-playwright-x64-server2025-64-core`
⚠️ [chromium-library] › library/chromium/connect-over-cdp.spec.ts:117 › CD-004 should connect when an existing page has been discarded `@msedge-dev-playwright-x64-server2025-64-core`
⚠️ [chromium-library] › library/chromium/connect-over-cdp.spec.ts:239 › CD-008 should connectOverCDP and manage downloads in default context `@msedge-dev-playwright-x64-server2025-64-core`
⚠️ [chromium-library] › library/chromium/extensions.spec.ts:155 › MV3 › CR-040 should report console messages from content script `@msedge-dev-playwright-x64-server2025-64-core`
⚠️ [chromium-library] › library/downloads-path.spec.ts:105 › downloads path › DO-044 should delete downloads when persistent context closes `@msedge-dev-playwright-x64-server2025-64-core`
⚠️ [chromium-library] › library/beforeunload.spec.ts:20 › BU-001 should close browser with beforeunload page `@chromium-macos-15-large`
⚠️ [chromium-library] › library/chromium/css-coverage.spec.ts:112 › CV-015 should report stylesheets across navigations `@chromium-macos-15-large`
⚠️ [chromium-library] › library/downloads-path.spec.ts:105 › downloads path › DO-044 should delete downloads when persistent context closes `@msedge-playwright-x64-server2025-64-core`
⚠️ [chromium-library] › library/webmcp.spec.ts:238 › WM-013 should call same-name tools in their own frame `@realtime-time-library-chromium-linux`
⚠️ [chromium-library] › library/popup.spec.ts:279 › PO-028 should not throw when click closes popup `@chrome-beta-ubuntu-22.04`
⚠️ [chromium-library] › library/capabilities.spec.ts:105 › CA-008 should support webgl Radoslav Kirilov (@smoke) `@chrome-macos-latest`
⚠️ [chromium-library] › library/trace-viewer.spec.ts:1717 › TV-077 should highlight locator in iframe while typing `@chrome-macos-latest`
⚠️ [chromium-library] › library/trace-viewer.spec.ts:2009 › TV-089 canvas disabled title `@chrome-macos-latest`
⚠️ [firefox-page] › page/page-add-init-script-callback.spec.ts:50 › IS-016 should pass arguments to the callback `@firefox-macos-15-large`
⚠️ [firefox-library] › library/beforeunload.spec.ts:20 › BU-001 should close browser with beforeunload page `@firefox-playwright-x64-server2025-64-core`
⚠️ [firefox-library] › library/browsercontext-proxy.spec.ts:46 › PR-019 should ignore legacy 'per-context' launch proxy `@firefox-playwright-x64-server2025-64-core`
⚠️ [firefox-library] › library/browsercontext-reuse.spec.ts:117 › reuse launch › BC-074 should reset serviceworker `@firefox-playwright-x64-server2025-64-core`
⚠️ [firefox-library] › library/browsercontext-reuse.spec.ts:339 › reuse launch › BC-081 should continue issuing events after closing the reused page `@firefox-playwright-x64-server2025-64-core`
⚠️ [firefox-library] › library/browsercontext-reuse.spec.ts:339 › reuse connect › BC-081 should continue issuing events after closing the reused page `@firefox-playwright-x64-server2025-64-core`
⚠️ [firefox-library] › library/browsertype-launch.spec.ts:22 › BT-004 should reject all promises when browser is closed `@firefox-playwright-x64-server2025-64-core`
⚠️ [firefox-library] › library/browsertype-launch.spec.ts:122 › BT-017 should allow await using `@firefox-playwright-x64-server2025-64-core`
⚠️ [firefox-library] › library/capabilities.spec.ts:178 › CA-015 serviceWorker should intercept document request `@firefox-playwright-x64-server2025-64-core`
⚠️ [firefox-library] › library/channels.spec.ts:230 › CN-005 should work with the domain module `@firefox-playwright-x64-server2025-64-core`
⚠️ [firefox-library] › library/client-certificates.spec.ts:570 › browser › CC-027 should not hang on tls errors during TLS 1.2 handshake `@firefox-playwright-x64-server2025-64-core`
⚠️ [firefox-library] › library/defaultbrowsercontext-1.spec.ts:89 › DC-004 should support viewport option `@firefox-playwright-x64-server2025-64-core`
⚠️ [firefox-library] › library/defaultbrowsercontext-2.spec.ts:54 › DC-017 should support contrast option `@firefox-playwright-x64-server2025-64-core`
⚠️ [firefox-library] › library/download.spec.ts:503 › download event › DO-026 should download large binary.zip `@firefox-playwright-x64-server2025-64-core`
⚠️ [firefox-library] › library/emulation-focus.spec.ts:218 › EM-024 should trigger hover state concurrently `@firefox-playwright-x64-server2025-64-core`
⚠️ [firefox-library] › library/firefox/launcher.spec.ts:77 › FF-004 should resize viewport with fractional device scale factor `@firefox-playwright-x64-server2025-64-core`
⚠️ [firefox-library] › library/har-websocket.spec.ts:234 › HA-103 should embed websocket messages `@firefox-playwright-x64-server2025-64-core`
⚠️ [firefox-library] › library/ignorehttpserrors.spec.ts:30 › NE-137 should isolate contexts `@firefox-playwright-x64-server2025-64-core`
⚠️ [firefox-library] › library/inspector/cli-codegen-1.spec.ts:21 › cli codegen › CG-001 should click `@firefox-playwright-x64-server2025-64-core`
⚠️ [firefox-library] › library/inspector/cli-codegen-1.spec.ts:729 › cli codegen › CG-026 should select `@firefox-playwright-x64-server2025-64-core`
⚠️ [firefox-library] › library/inspector/cli-codegen-3.spec.ts:878 › cli codegen › CG-085 should assert value on disabled select `@firefox-playwright-x64-server2025-64-core`
⚠️ [firefox-library] › library/inspector/cli-codegen-aria.spec.ts:21 › CG-096 should generate aria snapshot `@firefox-playwright-x64-server2025-64-core`
⚠️ [firefox-library] › library/inspector/cli-codegen-csharp.spec.ts:231 › CG-160 should work with --save-har and --save-har-glob in nunit `@firefox-playwright-x64-server2025-64-core`
⚠️ [firefox-library] › library/inspector/cli-codegen-csharp.spec.ts:221 › CG-159 should work with --save-har in xunit `@firefox-playwright-x64-server2025-64-core`
⚠️ [firefox-library] › library/inspector/cli-codegen-java.spec.ts:92 › CG-146 should work with --save-har and --save-har-glob as java-library `@firefox-playwright-x64-server2025-64-core`
⚠️ [firefox-library] › library/inspector/cli-codegen-python.spec.ts:125 › CG-126 should work with --save-har `@firefox-playwright-x64-server2025-64-core`
⚠️ [firefox-library] › library/inspector/cli-codegen-test.spec.ts:86 › CG-117 should not generate recordHAR with --save-har `@firefox-playwright-x64-server2025-64-core`
⚠️ [firefox-library] › library/inspector/cli-codegen-test.spec.ts:108 › CG-119 should generate routeFromHAR with --save-har and --save-har-glob `@firefox-playwright-x64-server2025-64-core`
⚠️ [firefox-library] › library/inspector/pause.spec.ts:398 › pause › IN-021 should populate log with expect failure `@firefox-playwright-x64-server2025-64-core`
⚠️ [firefox-library] › library/page-clock.frozen.spec.ts:19 › CK-055 clock should be frozen `@firefox-playwright-x64-server2025-64-core`
⚠️ [firefox-library] › library/page-close.spec.ts:22 › PA-039 should close page with active dialog `@firefox-playwright-x64-server2025-64-core`
⚠️ [firefox-library] › library/playwright-client.spec.ts:26 › PC-001 should connect from a page and drive the same browser `@firefox-playwright-x64-server2025-64-core`
⚠️ [firefox-library] › library/proxy.spec.ts:336 › PR-013 should use socks proxy in second page `@firefox-playwright-x64-server2025-64-core`
⚠️ [firefox-library] › library/selector-generator.spec.ts:446 › selector generator › GN-072 should find text in shadow dom `@firefox-playwright-x64-server2025-64-core`
⚠️ [firefox-library] › library/selector-generator.spec.ts:720 › selector generator › GN-103 should prefer role with hasText to css with hasText `@firefox-playwright-x64-server2025-64-core`
⚠️ [firefox-library] › library/trace-viewer.spec.ts:583 › TV-028 should filter network requests by multiple resource types `@firefox-playwright-x64-server2025-64-core`
⚠️ [firefox-library] › library/tracing.spec.ts:565 › TR-023 should produce screencast frames crop `@firefox-playwright-x64-server2025-64-core`
⚠️ [firefox-library] › library/video.spec.ts:475 › screencast › VI-018 should record video with the requested fps `@firefox-playwright-x64-server2025-64-core`
⚠️ [firefox-page] › page/expect-misc.spec.ts:539 › toHaveCSS › EX-231 custom css properties `@firefox-playwright-x64-server2025-64-core`
⚠️ [firefox-page] › page/locator-any-frame.spec.ts:272 › LO-027 should find a nested frame inside the scope `@firefox-playwright-x64-server2025-64-core`
⚠️ [firefox-page] › page/locator-query.spec.ts:304 › LO-182 count() should not throw during navigation `@firefox-playwright-x64-server2025-64-core`
⚠️ [firefox-page] › page/page-aria-snapshot-ai.spec.ts:567 › AR-073 should gracefully fallback when child frame cant be captured `@firefox-playwright-x64-server2025-64-core`
⚠️ [webkit-library] › library/heap.spec.ts:304 › LE-014 cycle handles `@webkit-playwright-x64-server2025-64-core`
⚠️ [webkit-library] › library/video.spec.ts:390 › screencast › VI-015 should scale frames down to the requested size `@webkit-playwright-x64-server2025-64-core`

126879 passed, 4122 skipped


Merge workflow run.

@github-actions

Copy link
Copy Markdown
Contributor

🟢 The CI failures look pre-existing, not caused by this PR

Hi, I'm the Playwright bot. I checked the 14 failed tests and the separate worker error; all have prior occurrences on main.

Details

I compared the latest merged report with the diff, refreshed the CI results database, and checked job logs. This PR changes Firefox only. Its changes do reach the Firefox tests, but their failures already occur before the r1564 → r1569 roll. The evidence below matches each test's project, file, title, and CI bot on independent main runs.

Pre-existing failures / flakes

  • Firefox, Windows — context reuse: browsercontext-reuse.spec.ts:200 (BC-076 should not cache resources) already reports Expected: 1 / Received: undefined on b851907, with Firefox r1564. :361 (BC-082 should work with routeWebSocket) also times out on 11f9e02. These are persistent baseline failures: respectively 43/43 and 42/43 final outcomes failed on the same Windows bot in the available main history.

  • Firefox, Windows — storage state: browsercontext-storage-state.spec.ts:119 (ST-004 should round-trip through the file) and :203 (ST-005 should round-trip OPFS) already time out on 6d2b35b, using r1564. :545 (ST-016 should support IndexedDB) has the identical App initialised. versus Database initialised. mismatch on 5cabe8e, where a retry passes.

  • Firefox, macOS — recorder: inspector/cli-codegen-aria.spec.ts:87 (CG-100 should update aria snapshot highlight) has the identical two-x-pw-highlight strict-mode error on 63fb731. On this same bot, it failed finally in 13/71 main runs and needed retries in another 28.

  • Edge, Windows: chromium/connect-over-cdp.spec.ts:202 (CD-007, missing trace) fails then passes on 11f9e02; :333 (CD-011, existing service workers) times out on b851907; downloads-path.spec.ts:91 (DO-043, persistent-context downloads) times out then passes on 0726df3. All match the affected Edge/Edge Dev bots. No Chromium implementation changes here.

  • Android — five failures: page-event-pageerror.spec.ts:20 (ER-001), selectors-get-by.spec.ts:117/:122/:140 (SE-082/083/086), and selectors-role.spec.ts:436 (SE-060) all have the same error-stack, label-lookup, or accessible-name errors on 11f9e02. These are pre-existing failures, not evidence against this Firefox roll; ER-001 fails in all 71 available main runs.

  • Separate Firefox worker error, Windows: the log reports Worker teardown timeout of 30000ms exceeded. The identical out-of-test error occurs on b851907, whose log confirms Firefox r1564.

No reported failure needs this PR's changes to occur.

Triaged by the Playwright bot - agent run

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant