Skip to content

feat(firefox): roll to r1577 - #44029

Merged
Yury Semikhatsky (yury-s) merged 1 commit into
mainfrom
roll-into-pw-firefox/1577
Nov 10, 2026
Merged

Yury Semikhatsky (yury-s) merged 1 commit into
mainfrom
roll-into-pw-firefox/1577

Conversation

@microsoft-playwright-automation

Copy link
Copy Markdown
Contributor

Browser build: https://github.com/microsoft/playwright-browsers/commit/a7f02f1ad5bff2213a95b41dd9eb7a567bba9d79. Build has full platform coverage - check that all tests pass there.

@github-actions

This comment has been minimized.

@github-actions

Copy link
Copy Markdown
Contributor

🟡 Two Firefox failures remain uncertain

Hi, I'm the Playwright bot. I checked the CI failures against this PR and earlier runs. The other 11 failed tests have matching failures before this PR; I found no proven regression from the roll.

Details

Checked head 50004d8a and the latest merged report: 13 failed tests and two fatal errors. The PR rolls Firefox r1575 to r1577 and changes file-picker completion and focus/input-state handling. It does not change Chromium. Historical comparisons use the refreshed test-results database, matching project, file and test title, excluding this PR and runs started after its CI began. tests 1 and MCP are still running.

Uncertain — Intel macOS Firefox

  • page/expect-misc.spec.ts:402, EX-220 resolve predicate after retries (firefox-page): all four attempts fail because the URL remains at A rather than B. The test starts navigation after 500 ms and allows only 1,000 ms for the assertion, so a scheduling delay could explain it. However, all 1,600 earlier Firefox runs passed without a failed attempt, including 258 on this same configuration. There is no evidence to call this a pre-existing flake, nor a demonstrated link to the changed focus handling.
  • library/proxy.spec.ts:434, PR-017 should use http proxy for websocket requests (firefox-library): all four attempts time out at 60 seconds. Both fatal errors are 60-second worker teardown timeouts, and the job log identifies this as the only test in each affected worker. This test previously timed out and passed on retry on Windows, main a2b65a0, but all 258 earlier Intel macOS runs were clean. That does not establish that the current macOS hang and teardown failures have the same cause.

Neither test exercises a file picker or selection dragging. Compare r1575 and r1577 on the same Intel macOS runner, with action and teardown logs, to distinguish a browser regression from CI delays.

Pre-existing — not evidence against this PR

  • Three Chromium Intel macOS timeouts: library/beforeunload.spec.ts:20 (BU-001) and library/browsercontext-basic.spec.ts:36 (BC-002) already timed out and passed on retry on the exact base commit, main 452a71b. library/browsertype-connect.spec.ts:288 (BT-048, connect headers) already failed after retries with the same 180-second timeout on main b8336b3. This Firefox-only diff cannot explain these Chromium failures.
  • Six Firefox Intel macOS code-generation failures: CG-158 NUnit, CG-107, CG-110, CG-124 and CG-112 have earlier missing-navigation or empty-output failures on main 489470e; CG-158 MSTest has the same missing Page.GotoAsync failure, rescued on retry, on main b43d534. Each test passed 254–256 of 258 earlier runs on this configuration.
  • library/multiclient.spec.ts:446, MC-020 (firefox-library, Intel macOS): the same 3-second locator-handler click timeout already occurred and passed on retry on main b43d534.
  • library/web-socket.spec.ts:276, WS-041 (firefox-library, Windows): already failing on the exact base, not merely suspected flaky. The identical page.goto('/parent') load timeout fails after retries on main 452a71b and main ab5fac4.

Triaged by the Playwright bot - agent run

@github-actions

This comment has been minimized.

@github-actions

Copy link
Copy Markdown
Contributor

Test results for "tests 1"

Warning

The triggering workflow run ended with status cancelled. Results below may be incomplete — blob reports from cancelled or timed-out shards are missing, so passing/failing counts do not reflect the full test suite.

18581 passed, 559 skipped


Merge workflow run.

@github-actions

Copy link
Copy Markdown
Contributor

Test results for "MCP"

5229 passed, 637 skipped


Merge workflow run.

@yury-s
Yury Semikhatsky (yury-s) merged commit c6405a9 into main Nov 10, 2026
98 of 103 checks passed
@yury-s
Yury Semikhatsky (yury-s) deleted the roll-into-pw-firefox/1577 branch November 10, 2026 19:14
@github-actions

Copy link
Copy Markdown
Contributor

Test results for "tests 2"

13 flaky ⚠️ [chromium-page] › page/workers.spec.ts:79 › WO-005 should have timestamp on worker console messages `@chromium-playwright-x64-server2025-64-core`
⚠️ [chromium-page] › page/page-screenshot.spec.ts:550 › page screenshot › SS-039 should take fullPage screenshots during navigation `@tracing-chromium`
⚠️ [chromium-library] › library/browsercontext-user-agent.spec.ts:127 › UA-006 should work for navigator.userAgentData and sec-ch-ua headers `@msedge-dev-playwright-x64-server2025-64-core`
⚠️ [chromium-library] › library/tracing.spec.ts:565 › TR-023 should produce screencast frames crop `@chromium-macos-15-large`
⚠️ [chromium-library] › library/chromium/connect-over-cdp.spec.ts:146 › CD-004 should connect when an existing page has been discarded `@chromium-macos-15-xlarge`
⚠️ [chromium-library] › library/trace-viewer.spec.ts:1937 › TV-087 should not leak recorders `@chromium-macos-15-xlarge`
⚠️ [chromium-library] › library/beforeunload.spec.ts:130 › BU-009 should support dismissing the dialog multiple times `@chrome-macos-latest`
⚠️ [chromium-library] › library/browsercontext-fetch.spec.ts:1419 › FE-168 should abort requests when browser context closes `@chromium-ubuntu-22.04-arm-node22`
⚠️ [firefox-page] › page/page-filechooser.spec.ts:293 › FC-020 should be able to reset selected files with empty file list `@firefox-macos-15-large`
⚠️ [webkit-library] › library/heap.spec.ts:304 › LE-014 cycle handles `@webkit-playwright-x64-server2025-64-core`
⚠️ [webkit-library] › library/tracing.spec.ts:565 › TR-023 should produce screencast frames scale `@webkit-playwright-x64-server2025-64-core`
⚠️ [webkit-library] › library/modernizr.spec.ts:35 › CA-030 Safari Desktop `@webkit-macos-15-xlarge`
⚠️ [webkit-library] › library/trace-viewer.spec.ts:2009 › TV-089 canvas disabled title `@webkit-macos-15-xlarge`

127118 passed, 4109 skipped


Merge workflow run.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant