Repository navigation
test: retry Playwright tests in CI - #466
Conversation
|
The following accounts have interacted with this PR and/or linked issues. I will continue to update these lists as activity occurs. You can also manually ask me to refresh this list by adding the Core Committers: Use this line as a base for the props when committing in SVN: To understand the WordPress project's expectations around crediting contributors, please review the Contributor Attribution page in the Core Handbook. |
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## main #466 +/- ##
============================================
- Coverage 96.36% 95.85% -0.52%
- Complexity 240 255 +15
============================================
Files 19 21 +2
Lines 2835 3014 +179
============================================
+ Hits 2732 2889 +157
- Misses 103 125 +22
Flags with carried forward coverage won't be shown. Click here to find out more. 🚀 New features to boost your workflow:
|
i-am-chitti
left a comment
There was a problem hiding this comment.
Tried it locally: 2 retries in CI, 0 on my machine, all 44 tests still found. Also checked the specs start fresh on a retry. So, no new flakiness.
#372 is already merged. So, no blocker here.
LGTM 🚀
Nit: @muneeb-ashraf Could you fill in the template's Use of AI Tools block (AI assistance: / Tool(s): / Model(s):)? The current PR description doesn't say which model.
|
Updated the PR description with the complete disclosure block, including the tool, model, and usage. Thanks for the catch. |
Add two Playwright retries in CI while preserving zero retries for local runs. This allows transient wordpress.org timeouts to be retried without masking failures during local development.
Fixes #403
Testing
npx playwright test --config tests/e2e/playwright.config.js --list- 44 tests discovered.npm run test:unit -- --runInBand- 21 tests passed.npm run test:scripts- 79 tests passed.git diff --checkUse of AI Tools
AI assistance: Yes
Tool(s): OpenAI Codex
Model(s): GPT-5
Used for: Code and tests.