Skip to content

Add one visible retry to remote E2E tests - #8332

Draft
isaacroldan wants to merge 1 commit into
mainfrom
isaac/e2e-visible-remote-retry
Draft

Add one visible retry to remote E2E tests#8332
isaacroldan wants to merge 1 commit into
mainfrom
isaac/e2e-visible-remote-retry

Conversation

@isaacroldan

Copy link
Copy Markdown
Contributor

Why

Remote E2E failures currently have no controlled retry. This makes transient failures look the same as persistent product failures.

What

  • Enable one retry for the remote project in CI only.
  • Keep local tests and remote authentication without retries.
  • Report first-attempt failures, passed retries, and persistent failures separately.
  • Include the retry index when generating app and store timestamps so each attempt has distinct cleanup targets.
  • Give the remote Playwright run 30 minutes inside a 40-minute CI job.

Testing

  • pnpm --filter e2e lint
  • pnpm --filter e2e type-check
  • pnpm --filter e2e exec playwright test tests/retry-behavior.spec.ts --project local
  • pnpm --filter e2e exec playwright test --project local
  • Loaded the retry reporter with CI configuration.
  • Verified local and remote-auth use zero retries and remote uses one retry.
  • Parsed tests-pr.yml as YAML.

Assisted-By: devx/215513a9-13fa-4e74-bb8f-79faee6e4f09
@github-actions github-actions Bot added the no-changelog This PR doesn't include a changeset entry. Is an internal only change not relevant to end users. label Aug 14, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

no-changelog This PR doesn't include a changeset entry. Is an internal only change not relevant to end users.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant