Flaky Tests (beta)
Detect and eliminate flaky tests.
Flaky Tests is currently available by invite only. Please sign up for the waitlist for access.
Monitoring Flaky Tests
Flaky tests are monitored by regularly running your test suites on branches that should not have test failures and tracking those failures. This is typically main or master, but can also be other branches that are expected not to fail like production, release, etc., depending on your workflow.
To start monitoring flaky tests, set up an automated CI job that runs your tests and uploads the resulting JUnit XML test report. See Framework Configuration to learn how to enable XML output for your particular testing framework.
Quickstart
Detecting Flaky Tests on Pull Requests
By uploading JUnit XML test results on pull requests, you get:
Metrics about how flaky tests affect your team's velocity
Metrics about how flaky tests reduce trust in your test suite
Reports on each Pull Request about which failed tests are known to be flaky
Last updated